2023-11-20 08:53:26,051 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor timeout: 13 mins 2023-11-20 08:53:26,304 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c2019f36-b591-93b3-961c-17512c63a77c 2023-11-20 08:53:26,320 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=1, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-11-20 08:53:26,321 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c2019f36-b591-93b3-961c-17512c63a77c/cluster_0312bc5e-93c7-79f4-9931-0016dabc1303, deleteOnExit=true 2023-11-20 08:53:26,321 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-11-20 08:53:26,321 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c2019f36-b591-93b3-961c-17512c63a77c/test.cache.data in system properties and HBase conf 2023-11-20 08:53:26,322 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c2019f36-b591-93b3-961c-17512c63a77c/hadoop.tmp.dir in system properties and HBase conf 2023-11-20 08:53:26,323 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c2019f36-b591-93b3-961c-17512c63a77c/hadoop.log.dir in system properties and HBase conf 2023-11-20 08:53:26,323 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c2019f36-b591-93b3-961c-17512c63a77c/mapreduce.cluster.local.dir in system properties and HBase conf 2023-11-20 08:53:26,324 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c2019f36-b591-93b3-961c-17512c63a77c/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-11-20 08:53:26,324 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-11-20 08:53:26,459 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-11-20 08:53:26,856 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-11-20 08:53:26,860 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c2019f36-b591-93b3-961c-17512c63a77c/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-11-20 08:53:26,860 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c2019f36-b591-93b3-961c-17512c63a77c/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-11-20 08:53:26,861 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c2019f36-b591-93b3-961c-17512c63a77c/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-11-20 08:53:26,861 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c2019f36-b591-93b3-961c-17512c63a77c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-11-20 08:53:26,861 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c2019f36-b591-93b3-961c-17512c63a77c/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-11-20 08:53:26,862 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c2019f36-b591-93b3-961c-17512c63a77c/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-11-20 08:53:26,862 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c2019f36-b591-93b3-961c-17512c63a77c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-11-20 08:53:26,863 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c2019f36-b591-93b3-961c-17512c63a77c/dfs.journalnode.edits.dir in system properties and HBase conf 2023-11-20 08:53:26,863 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c2019f36-b591-93b3-961c-17512c63a77c/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-11-20 08:53:26,864 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c2019f36-b591-93b3-961c-17512c63a77c/nfs.dump.dir in system properties and HBase conf 2023-11-20 08:53:26,864 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c2019f36-b591-93b3-961c-17512c63a77c/java.io.tmpdir in system properties and HBase conf 2023-11-20 08:53:26,864 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c2019f36-b591-93b3-961c-17512c63a77c/dfs.journalnode.edits.dir in system properties and HBase conf 2023-11-20 08:53:26,865 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c2019f36-b591-93b3-961c-17512c63a77c/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-11-20 08:53:26,865 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c2019f36-b591-93b3-961c-17512c63a77c/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-11-20 08:53:27,511 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-11-20 08:53:27,516 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-11-20 08:53:27,845 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-11-20 08:53:28,023 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-11-20 08:53:28,037 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-11-20 08:53:28,075 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-11-20 08:53:28,108 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c2019f36-b591-93b3-961c-17512c63a77c/java.io.tmpdir/Jetty_localhost_46109_hdfs____.sagcny/webapp 2023-11-20 08:53:28,253 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46109 2023-11-20 08:53:28,264 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-11-20 08:53:28,265 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-11-20 08:53:28,790 WARN [Listener at localhost/40427] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-11-20 08:53:28,880 WARN [Listener at localhost/40427] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-11-20 08:53:28,905 WARN [Listener at localhost/40427] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-11-20 08:53:28,913 INFO [Listener at localhost/40427] log.Slf4jLog(67): jetty-6.1.26 2023-11-20 08:53:28,919 INFO [Listener at localhost/40427] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c2019f36-b591-93b3-961c-17512c63a77c/java.io.tmpdir/Jetty_localhost_45839_datanode____ulfeuc/webapp 2023-11-20 08:53:29,039 INFO [Listener at localhost/40427] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45839 2023-11-20 08:53:29,441 WARN [Listener at localhost/43513] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-11-20 08:53:29,965 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6ab4f9ee99b50d59: Processing first storage report for DS-73a4bec0-2cce-406c-ba05-7d1f0e882648 from datanode b30ba5e9-376a-41c9-8c33-f7403000e804 2023-11-20 08:53:29,967 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6ab4f9ee99b50d59: from storage DS-73a4bec0-2cce-406c-ba05-7d1f0e882648 node DatanodeRegistration(127.0.0.1:46865, datanodeUuid=b30ba5e9-376a-41c9-8c33-f7403000e804, infoPort=42581, infoSecurePort=0, ipcPort=43513, storageInfo=lv=-57;cid=testClusterID;nsid=1825482163;c=1700470407596), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-11-20 08:53:29,967 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6ab4f9ee99b50d59: Processing first storage report for DS-397d5b52-3e59-49ff-a1f1-9c076d092bf2 from datanode b30ba5e9-376a-41c9-8c33-f7403000e804 2023-11-20 08:53:29,967 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6ab4f9ee99b50d59: from storage DS-397d5b52-3e59-49ff-a1f1-9c076d092bf2 node DatanodeRegistration(127.0.0.1:46865, datanodeUuid=b30ba5e9-376a-41c9-8c33-f7403000e804, infoPort=42581, infoSecurePort=0, ipcPort=43513, storageInfo=lv=-57;cid=testClusterID;nsid=1825482163;c=1700470407596), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-11-20 08:53:30,027 DEBUG [Listener at localhost/43513] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c2019f36-b591-93b3-961c-17512c63a77c 2023-11-20 08:53:30,156 INFO [Listener at localhost/43513] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c2019f36-b591-93b3-961c-17512c63a77c/cluster_0312bc5e-93c7-79f4-9931-0016dabc1303/zookeeper_0, clientPort=64635, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c2019f36-b591-93b3-961c-17512c63a77c/cluster_0312bc5e-93c7-79f4-9931-0016dabc1303/zookeeper_0/version-2, dataDirSize=457 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c2019f36-b591-93b3-961c-17512c63a77c/cluster_0312bc5e-93c7-79f4-9931-0016dabc1303/zookeeper_0/version-2, dataLogSize=457 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, clientPortListenBacklog=-1, serverId=0 2023-11-20 08:53:30,171 INFO [Listener at localhost/43513] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=64635 2023-11-20 08:53:30,178 INFO [Listener at localhost/43513] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-20 08:53:30,180 INFO [Listener at localhost/43513] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-20 08:53:30,849 INFO [Listener at localhost/43513] util.FSUtils(471): Created version file at hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24 with version=8 2023-11-20 08:53:30,849 INFO [Listener at localhost/43513] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/hbase-staging 2023-11-20 08:53:31,139 INFO [Listener at localhost/43513] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-11-20 08:53:31,605 INFO [Listener at localhost/43513] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=3 2023-11-20 08:53:31,637 INFO [Listener at localhost/43513] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-20 08:53:31,638 INFO [Listener at localhost/43513] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-11-20 08:53:31,638 INFO [Listener at localhost/43513] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-11-20 08:53:31,638 INFO [Listener at localhost/43513] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-20 08:53:31,638 INFO [Listener at localhost/43513] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-11-20 08:53:31,832 INFO [Listener at localhost/43513] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-11-20 08:53:31,908 DEBUG [Listener at localhost/43513] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-11-20 08:53:32,008 INFO [Listener at localhost/43513] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36169 2023-11-20 08:53:32,018 INFO [Listener at localhost/43513] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-20 08:53:32,019 INFO [Listener at localhost/43513] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-20 08:53:32,043 INFO [Listener at localhost/43513] zookeeper.RecoverableZooKeeper(93): Process identifier=master:36169 connecting to ZooKeeper ensemble=127.0.0.1:64635 2023-11-20 08:53:32,085 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:361690x0, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-11-20 08:53:32,088 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:36169-0x10009ff2fad0000 connected 2023-11-20 08:53:32,122 DEBUG [Listener at localhost/43513] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-11-20 08:53:32,122 DEBUG [Listener at localhost/43513] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-20 08:53:32,126 DEBUG [Listener at localhost/43513] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-11-20 08:53:32,135 DEBUG [Listener at localhost/43513] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36169 2023-11-20 08:53:32,136 DEBUG [Listener at localhost/43513] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36169 2023-11-20 08:53:32,136 DEBUG [Listener at localhost/43513] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36169 2023-11-20 08:53:32,137 DEBUG [Listener at localhost/43513] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36169 2023-11-20 08:53:32,138 DEBUG [Listener at localhost/43513] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36169 2023-11-20 08:53:32,143 INFO [Listener at localhost/43513] master.HMaster(444): hbase.rootdir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24, hbase.cluster.distributed=false 2023-11-20 08:53:32,215 INFO [Listener at localhost/43513] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=3 2023-11-20 08:53:32,216 INFO [Listener at localhost/43513] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-20 08:53:32,216 INFO [Listener at localhost/43513] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-11-20 08:53:32,216 INFO [Listener at localhost/43513] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-11-20 08:53:32,216 INFO [Listener at localhost/43513] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-20 08:53:32,216 INFO [Listener at localhost/43513] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-11-20 08:53:32,221 INFO [Listener at localhost/43513] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-11-20 08:53:32,224 INFO [Listener at localhost/43513] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38491 2023-11-20 08:53:32,226 INFO [Listener at localhost/43513] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-11-20 08:53:32,232 DEBUG [Listener at localhost/43513] mob.MobFileCache(121): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-11-20 08:53:32,233 INFO [Listener at localhost/43513] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-20 08:53:32,236 INFO [Listener at localhost/43513] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-20 08:53:32,238 INFO [Listener at localhost/43513] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38491 connecting to ZooKeeper ensemble=127.0.0.1:64635 2023-11-20 08:53:32,242 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:384910x0, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-11-20 08:53:32,242 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:38491-0x10009ff2fad0001 connected 2023-11-20 08:53:32,243 DEBUG [Listener at localhost/43513] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-11-20 08:53:32,244 DEBUG [Listener at localhost/43513] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-20 08:53:32,245 DEBUG [Listener at localhost/43513] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-11-20 08:53:32,245 DEBUG [Listener at localhost/43513] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38491 2023-11-20 08:53:32,246 DEBUG [Listener at localhost/43513] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38491 2023-11-20 08:53:32,246 DEBUG [Listener at localhost/43513] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38491 2023-11-20 08:53:32,247 DEBUG [Listener at localhost/43513] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38491 2023-11-20 08:53:32,248 DEBUG [Listener at localhost/43513] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38491 2023-11-20 08:53:32,252 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,36169,1700470410986 2023-11-20 08:53:32,264 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-11-20 08:53:32,267 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,36169,1700470410986 2023-11-20 08:53:32,293 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-11-20 08:53:32,293 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-11-20 08:53:32,294 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-20 08:53:32,294 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-11-20 08:53:32,296 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,36169,1700470410986 from backup master directory 2023-11-20 08:53:32,296 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-11-20 08:53:32,300 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,36169,1700470410986 2023-11-20 08:53:32,300 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-11-20 08:53:32,301 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-11-20 08:53:32,301 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,36169,1700470410986 2023-11-20 08:53:32,304 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-11-20 08:53:32,305 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-11-20 08:53:32,389 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/hbase.id with ID: 84d15db9-459d-44ea-9976-45cb07cfa5cf 2023-11-20 08:53:32,432 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-20 08:53:32,449 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-20 08:53:32,486 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x4002c902 to 127.0.0.1:64635 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-20 08:53:32,517 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@631487e8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-20 08:53:32,539 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-11-20 08:53:32,542 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-11-20 08:53:32,560 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-11-20 08:53:32,560 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-11-20 08:53:32,562 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-11-20 08:53:32,566 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-11-20 08:53:32,567 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-11-20 08:53:32,610 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/MasterData/data/master/store-tmp 2023-11-20 08:53:32,637 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-20 08:53:32,637 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-11-20 08:53:32,637 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-20 08:53:32,637 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-20 08:53:32,637 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-11-20 08:53:32,637 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-20 08:53:32,638 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-20 08:53:32,638 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-11-20 08:53:32,639 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/MasterData/WALs/jenkins-hbase4.apache.org,36169,1700470410986 2023-11-20 08:53:32,661 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36169%2C1700470410986, suffix=, logDir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/MasterData/WALs/jenkins-hbase4.apache.org,36169,1700470410986, archiveDir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/MasterData/oldWALs, maxLogs=10 2023-11-20 08:53:32,725 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46865,DS-73a4bec0-2cce-406c-ba05-7d1f0e882648,DISK] 2023-11-20 08:53:32,736 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:499) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:407) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-11-20 08:53:32,799 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/MasterData/WALs/jenkins-hbase4.apache.org,36169,1700470410986/jenkins-hbase4.apache.org%2C36169%2C1700470410986.1700470412671 2023-11-20 08:53:32,799 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46865,DS-73a4bec0-2cce-406c-ba05-7d1f0e882648,DISK]] 2023-11-20 08:53:32,800 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-11-20 08:53:32,801 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-20 08:53:32,804 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-11-20 08:53:32,805 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-11-20 08:53:32,872 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-11-20 08:53:32,880 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-11-20 08:53:32,912 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-11-20 08:53:32,926 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-20 08:53:32,933 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-11-20 08:53:32,934 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-11-20 08:53:32,952 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-11-20 08:53:32,957 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-20 08:53:32,958 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59125647, jitterRate=-0.1189592033624649}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-20 08:53:32,958 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-11-20 08:53:32,960 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-11-20 08:53:32,978 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-11-20 08:53:32,978 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-11-20 08:53:32,980 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-11-20 08:53:32,982 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 0 msec 2023-11-20 08:53:33,020 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 38 msec 2023-11-20 08:53:33,020 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-11-20 08:53:33,045 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-11-20 08:53:33,052 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-11-20 08:53:33,079 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-11-20 08:53:33,083 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-11-20 08:53:33,085 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-11-20 08:53:33,090 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-11-20 08:53:33,094 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-11-20 08:53:33,098 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-20 08:53:33,099 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-11-20 08:53:33,100 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-11-20 08:53:33,113 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-11-20 08:53:33,118 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-11-20 08:53:33,118 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-11-20 08:53:33,119 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-20 08:53:33,119 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,36169,1700470410986, sessionid=0x10009ff2fad0000, setting cluster-up flag (Was=false) 2023-11-20 08:53:33,136 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-20 08:53:33,144 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-11-20 08:53:33,146 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,36169,1700470410986 2023-11-20 08:53:33,151 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-20 08:53:33,159 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-11-20 08:53:33,161 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,36169,1700470410986 2023-11-20 08:53:33,163 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.hbase-snapshot/.tmp 2023-11-20 08:53:33,254 INFO [RS:0;jenkins-hbase4:38491] regionserver.HRegionServer(951): ClusterId : 84d15db9-459d-44ea-9976-45cb07cfa5cf 2023-11-20 08:53:33,258 DEBUG [RS:0;jenkins-hbase4:38491] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-11-20 08:53:33,270 DEBUG [RS:0;jenkins-hbase4:38491] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-11-20 08:53:33,271 DEBUG [RS:0;jenkins-hbase4:38491] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-11-20 08:53:33,275 DEBUG [RS:0;jenkins-hbase4:38491] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-11-20 08:53:33,278 DEBUG [RS:0;jenkins-hbase4:38491] zookeeper.ReadOnlyZKClient(139): Connect 0x72d5a428 to 127.0.0.1:64635 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-20 08:53:33,284 DEBUG [RS:0;jenkins-hbase4:38491] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7c125402, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-20 08:53:33,284 DEBUG [RS:0;jenkins-hbase4:38491] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@782dcf58, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-11-20 08:53:33,301 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-11-20 08:53:33,315 DEBUG [RS:0;jenkins-hbase4:38491] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:38491 2023-11-20 08:53:33,315 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-11-20 08:53:33,315 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-11-20 08:53:33,316 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-11-20 08:53:33,316 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-11-20 08:53:33,316 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-11-20 08:53:33,316 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-20 08:53:33,316 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-11-20 08:53:33,316 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-20 08:53:33,317 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1700470443317 2023-11-20 08:53:33,319 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-11-20 08:53:33,321 INFO [RS:0;jenkins-hbase4:38491] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-11-20 08:53:33,321 INFO [RS:0;jenkins-hbase4:38491] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-11-20 08:53:33,321 DEBUG [RS:0;jenkins-hbase4:38491] regionserver.HRegionServer(1022): About to register with Master. 2023-11-20 08:53:33,325 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-11-20 08:53:33,325 INFO [RS:0;jenkins-hbase4:38491] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,36169,1700470410986 with isa=jenkins-hbase4.apache.org/172.31.14.131:38491, startcode=1700470412215 2023-11-20 08:53:33,326 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-11-20 08:53:33,332 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-11-20 08:53:33,334 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-11-20 08:53:33,340 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-11-20 08:53:33,341 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-11-20 08:53:33,341 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-11-20 08:53:33,342 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-11-20 08:53:33,347 DEBUG [RS:0;jenkins-hbase4:38491] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-11-20 08:53:33,349 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-11-20 08:53:33,352 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-11-20 08:53:33,354 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-11-20 08:53:33,355 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-11-20 08:53:33,358 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-11-20 08:53:33,359 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-11-20 08:53:33,365 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1700470413364,5,FailOnTimeoutGroup] 2023-11-20 08:53:33,365 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1700470413365,5,FailOnTimeoutGroup] 2023-11-20 08:53:33,365 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-11-20 08:53:33,365 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-11-20 08:53:33,367 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-11-20 08:53:33,367 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-11-20 08:53:33,409 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45237, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-11-20 08:53:33,421 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36169] master.ServerManager(388): Registering regionserver=jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:33,437 DEBUG [RS:0;jenkins-hbase4:38491] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24 2023-11-20 08:53:33,437 DEBUG [RS:0;jenkins-hbase4:38491] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:40427 2023-11-20 08:53:33,437 DEBUG [RS:0;jenkins-hbase4:38491] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-11-20 08:53:33,442 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-11-20 08:53:33,443 DEBUG [RS:0;jenkins-hbase4:38491] zookeeper.ZKUtil(162): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:33,443 WARN [RS:0;jenkins-hbase4:38491] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-11-20 08:53:33,444 INFO [RS:0;jenkins-hbase4:38491] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-11-20 08:53:33,444 DEBUG [RS:0;jenkins-hbase4:38491] regionserver.HRegionServer(1948): logDir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/WALs/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:33,445 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,38491,1700470412215] 2023-11-20 08:53:33,454 DEBUG [RS:0;jenkins-hbase4:38491] zookeeper.ZKUtil(162): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:33,464 DEBUG [RS:0;jenkins-hbase4:38491] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-11-20 08:53:33,472 INFO [RS:0;jenkins-hbase4:38491] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-11-20 08:53:33,490 INFO [RS:0;jenkins-hbase4:38491] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-11-20 08:53:33,494 INFO [RS:0;jenkins-hbase4:38491] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-20 08:53:33,494 INFO [RS:0;jenkins-hbase4:38491] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-20 08:53:33,495 INFO [RS:0;jenkins-hbase4:38491] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-11-20 08:53:33,502 INFO [RS:0;jenkins-hbase4:38491] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=100, unit=MILLISECONDS is enabled. 2023-11-20 08:53:33,502 DEBUG [RS:0;jenkins-hbase4:38491] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-20 08:53:33,502 DEBUG [RS:0;jenkins-hbase4:38491] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-20 08:53:33,502 DEBUG [RS:0;jenkins-hbase4:38491] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-20 08:53:33,503 DEBUG [RS:0;jenkins-hbase4:38491] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-20 08:53:33,503 DEBUG [RS:0;jenkins-hbase4:38491] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-20 08:53:33,503 DEBUG [RS:0;jenkins-hbase4:38491] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-11-20 08:53:33,503 DEBUG [RS:0;jenkins-hbase4:38491] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-20 08:53:33,503 DEBUG [RS:0;jenkins-hbase4:38491] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-20 08:53:33,503 DEBUG [RS:0;jenkins-hbase4:38491] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-20 08:53:33,504 DEBUG [RS:0;jenkins-hbase4:38491] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-20 08:53:33,505 INFO [RS:0;jenkins-hbase4:38491] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-11-20 08:53:33,505 INFO [RS:0;jenkins-hbase4:38491] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-11-20 08:53:33,505 INFO [RS:0;jenkins-hbase4:38491] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-11-20 08:53:33,522 INFO [RS:0;jenkins-hbase4:38491] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-11-20 08:53:33,524 INFO [RS:0;jenkins-hbase4:38491] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38491,1700470412215-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-11-20 08:53:33,540 INFO [RS:0;jenkins-hbase4:38491] regionserver.Replication(203): jenkins-hbase4.apache.org,38491,1700470412215 started 2023-11-20 08:53:33,540 INFO [RS:0;jenkins-hbase4:38491] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,38491,1700470412215, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:38491, sessionid=0x10009ff2fad0001 2023-11-20 08:53:33,540 DEBUG [RS:0;jenkins-hbase4:38491] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-11-20 08:53:33,540 DEBUG [RS:0;jenkins-hbase4:38491] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:33,540 DEBUG [RS:0;jenkins-hbase4:38491] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38491,1700470412215' 2023-11-20 08:53:33,541 DEBUG [RS:0;jenkins-hbase4:38491] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:53:33,541 DEBUG [RS:0;jenkins-hbase4:38491] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:53:33,542 DEBUG [RS:0;jenkins-hbase4:38491] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-11-20 08:53:33,542 DEBUG [RS:0;jenkins-hbase4:38491] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-11-20 08:53:33,542 DEBUG [RS:0;jenkins-hbase4:38491] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:33,542 DEBUG [RS:0;jenkins-hbase4:38491] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38491,1700470412215' 2023-11-20 08:53:33,542 DEBUG [RS:0;jenkins-hbase4:38491] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-11-20 08:53:33,543 DEBUG [RS:0;jenkins-hbase4:38491] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-11-20 08:53:33,543 DEBUG [RS:0;jenkins-hbase4:38491] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-11-20 08:53:33,543 INFO [RS:0;jenkins-hbase4:38491] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-11-20 08:53:33,544 INFO [RS:0;jenkins-hbase4:38491] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-11-20 08:53:33,655 INFO [RS:0;jenkins-hbase4:38491] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38491%2C1700470412215, suffix=, logDir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/WALs/jenkins-hbase4.apache.org,38491,1700470412215, archiveDir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/oldWALs, maxLogs=32 2023-11-20 08:53:33,678 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46865,DS-73a4bec0-2cce-406c-ba05-7d1f0e882648,DISK] 2023-11-20 08:53:33,684 INFO [RS:0;jenkins-hbase4:38491] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/WALs/jenkins-hbase4.apache.org,38491,1700470412215/jenkins-hbase4.apache.org%2C38491%2C1700470412215.1700470413657 2023-11-20 08:53:33,685 DEBUG [RS:0;jenkins-hbase4:38491] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46865,DS-73a4bec0-2cce-406c-ba05-7d1f0e882648,DISK]] 2023-11-20 08:53:33,778 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-11-20 08:53:33,779 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-11-20 08:53:33,780 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24 2023-11-20 08:53:34,201 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-20 08:53:34,204 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-11-20 08:53:34,207 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/hbase/meta/1588230740/info 2023-11-20 08:53:34,208 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-11-20 08:53:34,209 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-20 08:53:34,210 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-11-20 08:53:34,212 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/hbase/meta/1588230740/rep_barrier 2023-11-20 08:53:34,213 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-11-20 08:53:34,213 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-20 08:53:34,214 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-11-20 08:53:34,215 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/hbase/meta/1588230740/table 2023-11-20 08:53:34,216 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-11-20 08:53:34,217 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-20 08:53:34,218 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/hbase/meta/1588230740 2023-11-20 08:53:34,219 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/hbase/meta/1588230740 2023-11-20 08:53:34,222 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-11-20 08:53:34,225 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-11-20 08:53:34,228 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-20 08:53:34,229 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59492688, jitterRate=-0.11348986625671387}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-11-20 08:53:34,229 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-11-20 08:53:34,229 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-11-20 08:53:34,229 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-11-20 08:53:34,229 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-11-20 08:53:34,229 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-11-20 08:53:34,229 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-11-20 08:53:34,230 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-11-20 08:53:34,230 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-11-20 08:53:34,236 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-11-20 08:53:34,236 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-11-20 08:53:34,243 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-11-20 08:53:34,254 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-11-20 08:53:34,256 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-11-20 08:53:34,408 DEBUG [jenkins-hbase4:36169] assignment.AssignmentManager(2186): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-11-20 08:53:34,411 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38491,1700470412215, state=OPENING 2023-11-20 08:53:34,419 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-11-20 08:53:34,421 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-20 08:53:34,422 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-11-20 08:53:34,425 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38491,1700470412215}] 2023-11-20 08:53:34,610 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:34,612 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-11-20 08:53:34,615 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52400, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-11-20 08:53:34,626 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-11-20 08:53:34,626 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-11-20 08:53:34,630 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38491%2C1700470412215.meta, suffix=.meta, logDir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/WALs/jenkins-hbase4.apache.org,38491,1700470412215, archiveDir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/oldWALs, maxLogs=32 2023-11-20 08:53:34,648 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46865,DS-73a4bec0-2cce-406c-ba05-7d1f0e882648,DISK] 2023-11-20 08:53:34,653 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/WALs/jenkins-hbase4.apache.org,38491,1700470412215/jenkins-hbase4.apache.org%2C38491%2C1700470412215.meta.1700470414632.meta 2023-11-20 08:53:34,653 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46865,DS-73a4bec0-2cce-406c-ba05-7d1f0e882648,DISK]] 2023-11-20 08:53:34,653 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-11-20 08:53:34,655 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-11-20 08:53:34,673 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-11-20 08:53:34,679 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-11-20 08:53:34,684 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-11-20 08:53:34,685 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-20 08:53:34,685 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-11-20 08:53:34,685 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-11-20 08:53:34,688 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-11-20 08:53:34,690 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/hbase/meta/1588230740/info 2023-11-20 08:53:34,690 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/hbase/meta/1588230740/info 2023-11-20 08:53:34,691 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-11-20 08:53:34,692 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-20 08:53:34,692 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-11-20 08:53:34,694 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/hbase/meta/1588230740/rep_barrier 2023-11-20 08:53:34,694 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/hbase/meta/1588230740/rep_barrier 2023-11-20 08:53:34,695 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-11-20 08:53:34,696 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-20 08:53:34,696 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-11-20 08:53:34,698 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/hbase/meta/1588230740/table 2023-11-20 08:53:34,698 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/hbase/meta/1588230740/table 2023-11-20 08:53:34,698 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-11-20 08:53:34,699 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-20 08:53:34,701 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/hbase/meta/1588230740 2023-11-20 08:53:34,704 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/hbase/meta/1588230740 2023-11-20 08:53:34,709 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-11-20 08:53:34,712 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-11-20 08:53:34,714 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65720686, jitterRate=-0.020685464143753052}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-11-20 08:53:34,714 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-11-20 08:53:34,727 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1700470414602 2023-11-20 08:53:34,746 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-11-20 08:53:34,747 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38491,1700470412215, state=OPEN 2023-11-20 08:53:34,747 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-11-20 08:53:34,753 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-11-20 08:53:34,753 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-11-20 08:53:34,758 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-11-20 08:53:34,758 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38491,1700470412215 in 328 msec 2023-11-20 08:53:34,763 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-11-20 08:53:34,764 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 516 msec 2023-11-20 08:53:34,769 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.5470 sec 2023-11-20 08:53:34,769 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1700470414769, completionTime=-1 2023-11-20 08:53:34,769 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(808): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-11-20 08:53:34,770 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1527): Joining cluster... 2023-11-20 08:53:34,832 DEBUG [hconnection-0x3dbf70ab-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-20 08:53:34,835 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52416, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-20 08:53:34,850 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1539): Number of RegionServers=1 2023-11-20 08:53:34,851 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1700470474851 2023-11-20 08:53:34,851 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1700470534851 2023-11-20 08:53:34,851 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1546): Joined the cluster in 80 msec 2023-11-20 08:53:34,873 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36169,1700470410986-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-11-20 08:53:34,873 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36169,1700470410986-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-11-20 08:53:34,873 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36169,1700470410986-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-11-20 08:53:34,875 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:36169, period=300000, unit=MILLISECONDS is enabled. 2023-11-20 08:53:34,875 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-11-20 08:53:34,884 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-11-20 08:53:34,891 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-11-20 08:53:34,893 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-11-20 08:53:34,902 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-11-20 08:53:34,904 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-11-20 08:53:34,907 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-20 08:53:34,930 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/hbase/namespace/6f71729b403c1b7661b596f9cabd3e13 2023-11-20 08:53:34,932 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/hbase/namespace/6f71729b403c1b7661b596f9cabd3e13 empty. 2023-11-20 08:53:34,933 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/hbase/namespace/6f71729b403c1b7661b596f9cabd3e13 2023-11-20 08:53:34,933 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-11-20 08:53:35,362 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-11-20 08:53:35,364 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6f71729b403c1b7661b596f9cabd3e13, NAME => 'hbase:namespace,,1700470414892.6f71729b403c1b7661b596f9cabd3e13.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp 2023-11-20 08:53:35,377 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1700470414892.6f71729b403c1b7661b596f9cabd3e13.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-20 08:53:35,377 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 6f71729b403c1b7661b596f9cabd3e13, disabling compactions & flushes 2023-11-20 08:53:35,377 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1700470414892.6f71729b403c1b7661b596f9cabd3e13. 2023-11-20 08:53:35,377 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1700470414892.6f71729b403c1b7661b596f9cabd3e13. 2023-11-20 08:53:35,378 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1700470414892.6f71729b403c1b7661b596f9cabd3e13. after waiting 0 ms 2023-11-20 08:53:35,378 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1700470414892.6f71729b403c1b7661b596f9cabd3e13. 2023-11-20 08:53:35,378 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1700470414892.6f71729b403c1b7661b596f9cabd3e13. 2023-11-20 08:53:35,378 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 6f71729b403c1b7661b596f9cabd3e13: 2023-11-20 08:53:35,382 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-11-20 08:53:35,397 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1700470414892.6f71729b403c1b7661b596f9cabd3e13.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1700470415385"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700470415385"}]},"ts":"1700470415385"} 2023-11-20 08:53:35,425 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-20 08:53:35,427 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-20 08:53:35,432 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700470415428"}]},"ts":"1700470415428"} 2023-11-20 08:53:35,435 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-11-20 08:53:35,443 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=6f71729b403c1b7661b596f9cabd3e13, ASSIGN}] 2023-11-20 08:53:35,446 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=6f71729b403c1b7661b596f9cabd3e13, ASSIGN 2023-11-20 08:53:35,447 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=6f71729b403c1b7661b596f9cabd3e13, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38491,1700470412215; forceNewPlan=false, retain=false 2023-11-20 08:53:35,598 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=6f71729b403c1b7661b596f9cabd3e13, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:35,598 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1700470414892.6f71729b403c1b7661b596f9cabd3e13.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1700470415598"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700470415598"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700470415598"}]},"ts":"1700470415598"} 2023-11-20 08:53:35,602 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 6f71729b403c1b7661b596f9cabd3e13, server=jenkins-hbase4.apache.org,38491,1700470412215}] 2023-11-20 08:53:35,756 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:35,762 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1700470414892.6f71729b403c1b7661b596f9cabd3e13. 2023-11-20 08:53:35,763 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6f71729b403c1b7661b596f9cabd3e13, NAME => 'hbase:namespace,,1700470414892.6f71729b403c1b7661b596f9cabd3e13.', STARTKEY => '', ENDKEY => ''} 2023-11-20 08:53:35,763 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 6f71729b403c1b7661b596f9cabd3e13 2023-11-20 08:53:35,764 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1700470414892.6f71729b403c1b7661b596f9cabd3e13.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-20 08:53:35,764 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6f71729b403c1b7661b596f9cabd3e13 2023-11-20 08:53:35,764 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6f71729b403c1b7661b596f9cabd3e13 2023-11-20 08:53:35,766 INFO [StoreOpener-6f71729b403c1b7661b596f9cabd3e13-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 6f71729b403c1b7661b596f9cabd3e13 2023-11-20 08:53:35,768 DEBUG [StoreOpener-6f71729b403c1b7661b596f9cabd3e13-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/hbase/namespace/6f71729b403c1b7661b596f9cabd3e13/info 2023-11-20 08:53:35,768 DEBUG [StoreOpener-6f71729b403c1b7661b596f9cabd3e13-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/hbase/namespace/6f71729b403c1b7661b596f9cabd3e13/info 2023-11-20 08:53:35,769 INFO [StoreOpener-6f71729b403c1b7661b596f9cabd3e13-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6f71729b403c1b7661b596f9cabd3e13 columnFamilyName info 2023-11-20 08:53:35,769 INFO [StoreOpener-6f71729b403c1b7661b596f9cabd3e13-1] regionserver.HStore(310): Store=6f71729b403c1b7661b596f9cabd3e13/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-20 08:53:35,771 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/hbase/namespace/6f71729b403c1b7661b596f9cabd3e13 2023-11-20 08:53:35,772 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/hbase/namespace/6f71729b403c1b7661b596f9cabd3e13 2023-11-20 08:53:35,776 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6f71729b403c1b7661b596f9cabd3e13 2023-11-20 08:53:35,779 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/hbase/namespace/6f71729b403c1b7661b596f9cabd3e13/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-20 08:53:35,780 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6f71729b403c1b7661b596f9cabd3e13; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72355616, jitterRate=0.07818269729614258}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-20 08:53:35,780 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6f71729b403c1b7661b596f9cabd3e13: 2023-11-20 08:53:35,782 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1700470414892.6f71729b403c1b7661b596f9cabd3e13., pid=6, masterSystemTime=1700470415756 2023-11-20 08:53:35,785 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1700470414892.6f71729b403c1b7661b596f9cabd3e13. 2023-11-20 08:53:35,786 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1700470414892.6f71729b403c1b7661b596f9cabd3e13. 2023-11-20 08:53:35,787 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=6f71729b403c1b7661b596f9cabd3e13, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:35,788 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1700470414892.6f71729b403c1b7661b596f9cabd3e13.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1700470415786"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700470415786"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700470415786"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700470415786"}]},"ts":"1700470415786"} 2023-11-20 08:53:35,795 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-11-20 08:53:35,795 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 6f71729b403c1b7661b596f9cabd3e13, server=jenkins-hbase4.apache.org,38491,1700470412215 in 189 msec 2023-11-20 08:53:35,798 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-11-20 08:53:35,798 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=6f71729b403c1b7661b596f9cabd3e13, ASSIGN in 352 msec 2023-11-20 08:53:35,800 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-20 08:53:35,800 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700470415800"}]},"ts":"1700470415800"} 2023-11-20 08:53:35,803 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-11-20 08:53:35,807 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-11-20 08:53:35,807 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-11-20 08:53:35,808 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-11-20 08:53:35,808 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-20 08:53:35,809 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 914 msec 2023-11-20 08:53:35,839 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-11-20 08:53:35,855 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-11-20 08:53:35,861 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 28 msec 2023-11-20 08:53:35,874 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-11-20 08:53:35,886 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-11-20 08:53:35,892 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 17 msec 2023-11-20 08:53:35,901 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-11-20 08:53:35,904 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-11-20 08:53:35,904 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.603sec 2023-11-20 08:53:35,906 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-11-20 08:53:35,908 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-11-20 08:53:35,908 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-11-20 08:53:35,909 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36169,1700470410986-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-11-20 08:53:35,910 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36169,1700470410986-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-11-20 08:53:35,924 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-11-20 08:53:35,960 DEBUG [Listener at localhost/43513] zookeeper.ReadOnlyZKClient(139): Connect 0x4c8d5c2e to 127.0.0.1:64635 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-20 08:53:35,965 DEBUG [Listener at localhost/43513] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@53d2c63f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-20 08:53:35,978 DEBUG [hconnection-0x5451e577-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-20 08:53:35,989 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52422, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-20 08:53:36,000 INFO [Listener at localhost/43513] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,36169,1700470410986 2023-11-20 08:53:36,001 DEBUG [Listener at localhost/43513] zookeeper.ReadOnlyZKClient(139): Connect 0x13bc198c to 127.0.0.1:64635 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-20 08:53:36,010 DEBUG [Listener at localhost/43513] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@25d40cdd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-20 08:53:36,011 INFO [Listener at localhost/43513] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-20 08:53:36,079 INFO [Listener at localhost/43513] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=213, OpenFileDescriptor=505, MaxFileDescriptor=60000, SystemLoadAverage=266, ProcessCount=170, AvailableMemoryMB=15485 2023-11-20 08:53:36,089 DEBUG [Listener at localhost/43513] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-20 08:53:36,092 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39566, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-20 08:53:36,105 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-20 08:53:36,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:36,109 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_PRE_OPERATION 2023-11-20 08:53:36,111 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-20 08:53:36,114 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d 2023-11-20 08:53:36,114 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthly" procId is: 9 2023-11-20 08:53:36,115 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d empty. 2023-11-20 08:53:36,118 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d 2023-11-20 08:53:36,118 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthly regions 2023-11-20 08:53:36,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-20 08:53:36,138 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-11-20 08:53:36,140 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7accaa801f4702def28f4caede725b1d, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp 2023-11-20 08:53:36,160 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-20 08:53:36,160 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1604): Closing 7accaa801f4702def28f4caede725b1d, disabling compactions & flushes 2023-11-20 08:53:36,160 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d. 2023-11-20 08:53:36,160 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d. 2023-11-20 08:53:36,160 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d. after waiting 0 ms 2023-11-20 08:53:36,160 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d. 2023-11-20 08:53:36,160 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d. 2023-11-20 08:53:36,160 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1558): Region close journal for 7accaa801f4702def28f4caede725b1d: 2023-11-20 08:53:36,164 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ADD_TO_META 2023-11-20 08:53:36,166 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1700470416166"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700470416166"}]},"ts":"1700470416166"} 2023-11-20 08:53:36,169 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-20 08:53:36,170 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-20 08:53:36,171 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700470416170"}]},"ts":"1700470416170"} 2023-11-20 08:53:36,173 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLING in hbase:meta 2023-11-20 08:53:36,177 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=7accaa801f4702def28f4caede725b1d, ASSIGN}] 2023-11-20 08:53:36,179 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=7accaa801f4702def28f4caede725b1d, ASSIGN 2023-11-20 08:53:36,181 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=7accaa801f4702def28f4caede725b1d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38491,1700470412215; forceNewPlan=false, retain=false 2023-11-20 08:53:36,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-20 08:53:36,332 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=7accaa801f4702def28f4caede725b1d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:36,333 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1700470416332"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700470416332"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700470416332"}]},"ts":"1700470416332"} 2023-11-20 08:53:36,336 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 7accaa801f4702def28f4caede725b1d, server=jenkins-hbase4.apache.org,38491,1700470412215}] 2023-11-20 08:53:36,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-20 08:53:36,489 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:36,496 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d. 2023-11-20 08:53:36,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7accaa801f4702def28f4caede725b1d, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d.', STARTKEY => '', ENDKEY => ''} 2023-11-20 08:53:36,497 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 7accaa801f4702def28f4caede725b1d 2023-11-20 08:53:36,497 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-20 08:53:36,497 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7accaa801f4702def28f4caede725b1d 2023-11-20 08:53:36,497 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7accaa801f4702def28f4caede725b1d 2023-11-20 08:53:36,501 INFO [StoreOpener-7accaa801f4702def28f4caede725b1d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 7accaa801f4702def28f4caede725b1d 2023-11-20 08:53:36,503 DEBUG [StoreOpener-7accaa801f4702def28f4caede725b1d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1 2023-11-20 08:53:36,503 DEBUG [StoreOpener-7accaa801f4702def28f4caede725b1d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1 2023-11-20 08:53:36,506 INFO [StoreOpener-7accaa801f4702def28f4caede725b1d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7accaa801f4702def28f4caede725b1d columnFamilyName family1 2023-11-20 08:53:36,509 INFO [StoreOpener-7accaa801f4702def28f4caede725b1d-1] regionserver.HStore(310): Store=7accaa801f4702def28f4caede725b1d/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-20 08:53:36,512 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d 2023-11-20 08:53:36,513 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d 2023-11-20 08:53:36,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7accaa801f4702def28f4caede725b1d 2023-11-20 08:53:36,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-20 08:53:36,526 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7accaa801f4702def28f4caede725b1d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61612104, jitterRate=-0.08190810680389404}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-20 08:53:36,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7accaa801f4702def28f4caede725b1d: 2023-11-20 08:53:36,527 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d., pid=11, masterSystemTime=1700470416489 2023-11-20 08:53:36,532 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=7accaa801f4702def28f4caede725b1d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:36,533 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1700470416532"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700470416532"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700470416532"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700470416532"}]},"ts":"1700470416532"} 2023-11-20 08:53:36,537 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d. 2023-11-20 08:53:36,537 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d. 2023-11-20 08:53:36,541 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-11-20 08:53:36,542 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 7accaa801f4702def28f4caede725b1d, server=jenkins-hbase4.apache.org,38491,1700470412215 in 201 msec 2023-11-20 08:53:36,546 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-11-20 08:53:36,546 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=7accaa801f4702def28f4caede725b1d, ASSIGN in 365 msec 2023-11-20 08:53:36,548 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-20 08:53:36,548 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700470416548"}]},"ts":"1700470416548"} 2023-11-20 08:53:36,551 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLED in hbase:meta 2023-11-20 08:53:36,556 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_POST_OPERATION 2023-11-20 08:53:36,559 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 451 msec 2023-11-20 08:53:36,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-20 08:53:36,737 INFO [Listener at localhost/43513] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthly, procId: 9 completed 2023-11-20 08:53:36,757 DEBUG [hconnection-0x331e6c02-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-20 08:53:36,761 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52432, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-20 08:53:36,914 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:53:36,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:36,921 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-20 08:53:36,921 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:53:36,921 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-20 08:53:36,921 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-20 08:53:36,922 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:36,922 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:36,924 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:53:36,924 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:36,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:53:36,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:53:36,924 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:36,924 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:53:36,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:36,925 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:36,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:53:36,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:36,926 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:36,927 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:36,928 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-20 08:53:36,928 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:53:36,928 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-20 08:53:36,929 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-20 08:53:36,929 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d. 2023-11-20 08:53:36,929 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:53:36,930 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d. started... 2023-11-20 08:53:36,931 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7accaa801f4702def28f4caede725b1d 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-20 08:53:37,497 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511304f8382902ca846a0b48d4e58bd4dc325 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511304f8382902ca846a0b48d4e58bd4dc325 2023-11-20 08:53:37,513 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/.tmp/family1/fc3f3914c5ef477795b2737c77f117e5 2023-11-20 08:53:37,524 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/.tmp/family1/fc3f3914c5ef477795b2737c77f117e5 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/fc3f3914c5ef477795b2737c77f117e5 2023-11-20 08:53:37,533 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/fc3f3914c5ef477795b2737c77f117e5, entries=1000, sequenceid=5, filesize=175.8 K 2023-11-20 08:53:37,537 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 7accaa801f4702def28f4caede725b1d in 606ms, sequenceid=5, compaction requested=false 2023-11-20 08:53:37,539 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-20 08:53:37,543 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7accaa801f4702def28f4caede725b1d: 2023-11-20 08:53:37,544 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d. 2023-11-20 08:53:37,544 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-20 08:53:37,544 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-20 08:53:37,544 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:37,545 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-20 08:53:37,545 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-20 08:53:37,547 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:37,547 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:37,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:37,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:53:37,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:53:37,548 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:37,548 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:53:37,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:53:37,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:53:37,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:37,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:37,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:53:37,551 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-20 08:53:37,551 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@53a53aa5[Count = 0] remaining members to acquire global barrier 2023-11-20 08:53:37,551 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-20 08:53:37,551 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:37,553 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:37,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:37,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:37,553 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-20 08:53:37,553 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-20 08:53:37,553 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:53:37,554 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:37,554 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:53:37,560 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:37,560 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-20 08:53:37,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:37,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:53:37,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:53:37,560 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:53:37,561 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-20 08:53:37,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:53:37,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:53:37,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:37,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:37,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:53:37,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:37,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:37,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:53:37,566 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-20 08:53:37,566 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-20 08:53:37,566 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:53:37,566 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:53:37,566 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:37,566 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:53:37,569 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:37,569 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:37,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:37,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:53:37,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:53:37,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:37,569 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:53:37,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:37,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:53:37,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:53:37,571 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:37,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:53:37,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:37,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:37,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:53:37,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:37,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:37,573 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:37,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:53:37,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:37,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:37,582 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:37,583 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:53:37,583 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:37,583 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:37,583 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:37,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:53:37,583 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:53:37,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:53:37,583 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:37,583 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:37,583 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:53:37,583 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:37,583 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-20 08:53:37,583 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:53:37,584 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:53:37,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:53:37,586 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-20 08:53:37,586 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:53:37,686 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:53:37,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:53:37,701 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:53:37,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-20 08:53:37,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:37,704 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-20 08:53:37,704 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:53:37,705 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-20 08:53:37,705 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-20 08:53:37,706 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:37,706 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:37,710 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:53:37,710 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:37,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:53:37,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:53:37,711 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:37,711 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:53:37,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:37,711 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:37,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:53:37,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:37,712 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:37,712 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-20 08:53:37,712 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:37,712 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-20 08:53:37,712 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:53:37,713 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-20 08:53:37,713 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-20 08:53:37,713 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:53:37,713 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d. 2023-11-20 08:53:37,713 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d. started... 2023-11-20 08:53:37,713 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7accaa801f4702def28f4caede725b1d 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-20 08:53:38,140 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112830f7fb4a355f4940b621737c0ccbd84a to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112830f7fb4a355f4940b621737c0ccbd84a 2023-11-20 08:53:38,159 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/.tmp/family1/7f22bfc6cc844043aa8a6c95b5572294 2023-11-20 08:53:38,170 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/.tmp/family1/7f22bfc6cc844043aa8a6c95b5572294 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/7f22bfc6cc844043aa8a6c95b5572294 2023-11-20 08:53:38,181 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/7f22bfc6cc844043aa8a6c95b5572294, entries=1, sequenceid=9, filesize=5.0 K 2023-11-20 08:53:38,182 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 7accaa801f4702def28f4caede725b1d in 469ms, sequenceid=9, compaction requested=false 2023-11-20 08:53:38,182 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7accaa801f4702def28f4caede725b1d: 2023-11-20 08:53:38,182 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d. 2023-11-20 08:53:38,182 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-20 08:53:38,183 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-20 08:53:38,183 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:38,183 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-20 08:53:38,183 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-20 08:53:38,186 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:38,186 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:38,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:38,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:53:38,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:53:38,187 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:38,187 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:53:38,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:53:38,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:53:38,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:38,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:38,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:53:38,189 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-20 08:53:38,189 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@22d25442[Count = 0] remaining members to acquire global barrier 2023-11-20 08:53:38,189 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-20 08:53:38,190 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:38,196 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:38,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:38,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:38,196 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-20 08:53:38,196 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-20 08:53:38,196 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:53:38,197 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:38,197 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:53:38,199 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:38,199 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-20 08:53:38,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:38,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:53:38,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:53:38,199 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:53:38,199 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-20 08:53:38,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:53:38,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:53:38,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:38,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:38,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:53:38,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:38,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:38,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:53:38,205 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-20 08:53:38,205 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-20 08:53:38,205 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:53:38,205 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:53:38,205 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:38,205 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:53:38,207 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:38,207 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:38,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:38,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:53:38,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:53:38,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:38,208 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:53:38,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:38,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:53:38,209 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:38,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:53:38,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:53:38,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:38,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:38,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:53:38,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:38,211 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:38,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:38,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:53:38,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:38,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:38,216 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:38,217 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:38,217 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:38,217 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:38,217 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:53:38,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:53:38,217 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:38,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:53:38,217 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-20 08:53:38,217 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:53:38,217 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:53:38,217 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:38,217 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:53:38,217 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:38,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:53:38,218 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-20 08:53:38,218 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:53:38,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:53:38,219 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-20 08:53:38,318 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:53:38,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:53:38,329 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:53:38,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-20 08:53:38,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:38,332 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-20 08:53:38,332 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:53:38,333 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-20 08:53:38,333 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-20 08:53:38,334 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:38,334 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:38,336 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:53:38,336 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:38,336 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:53:38,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:53:38,337 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:38,337 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:53:38,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:38,338 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:38,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:53:38,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:38,339 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:38,339 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-20 08:53:38,339 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:38,339 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-20 08:53:38,339 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:53:38,340 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-20 08:53:38,340 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-20 08:53:38,340 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:53:38,340 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d. 2023-11-20 08:53:38,340 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d. started... 2023-11-20 08:53:38,340 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7accaa801f4702def28f4caede725b1d 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-20 08:53:38,368 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512012bc0e7575019491787fec10e37d04507 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512012bc0e7575019491787fec10e37d04507 2023-11-20 08:53:38,783 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/.tmp/family1/48c3001028db4d3cbe5d5eba35b35922 2023-11-20 08:53:38,794 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/.tmp/family1/48c3001028db4d3cbe5d5eba35b35922 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/48c3001028db4d3cbe5d5eba35b35922 2023-11-20 08:53:38,805 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/48c3001028db4d3cbe5d5eba35b35922, entries=1, sequenceid=13, filesize=5.0 K 2023-11-20 08:53:38,807 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7accaa801f4702def28f4caede725b1d in 467ms, sequenceid=13, compaction requested=true 2023-11-20 08:53:38,808 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7accaa801f4702def28f4caede725b1d: 2023-11-20 08:53:38,808 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d. 2023-11-20 08:53:38,808 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-20 08:53:38,808 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-20 08:53:38,808 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:38,809 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-20 08:53:38,809 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-20 08:53:38,812 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:38,812 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:38,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:38,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:53:38,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:53:38,812 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:38,812 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:53:38,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:53:38,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:53:38,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:38,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:38,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:53:38,815 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-20 08:53:38,815 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3b385613[Count = 0] remaining members to acquire global barrier 2023-11-20 08:53:38,816 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-20 08:53:38,816 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:38,817 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:38,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:38,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:38,818 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-20 08:53:38,818 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-20 08:53:38,818 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:53:38,820 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:38,820 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:53:38,821 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-20 08:53:38,821 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:53:38,821 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-20 08:53:38,822 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:38,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:38,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:53:38,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:53:38,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:53:38,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:53:38,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:38,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:38,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:53:38,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:38,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:38,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:53:38,830 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-20 08:53:38,830 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-20 08:53:38,830 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:53:38,830 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:53:38,830 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:38,830 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:53:38,835 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:38,835 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:38,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:38,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:38,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:53:38,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:53:38,835 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:53:38,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:38,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:53:38,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:53:38,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:53:38,837 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:38,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:38,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:38,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:53:38,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:38,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:38,839 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:38,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:53:38,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:38,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:38,844 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:38,844 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:53:38,844 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:38,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:53:38,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:53:38,844 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:53:38,845 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:38,845 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:38,845 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:38,845 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:38,845 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-20 08:53:38,845 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:53:38,845 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-20 08:53:38,845 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:53:38,845 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:38,845 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:53:38,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:53:38,846 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-20 08:53:38,846 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:53:38,946 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:53:38,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:53:38,960 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:53:38,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-20 08:53:38,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:38,964 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-20 08:53:38,964 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:53:38,964 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-20 08:53:38,964 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-20 08:53:38,965 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:38,965 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:38,967 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:53:38,967 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:38,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:53:38,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:53:38,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:38,968 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:38,968 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:53:38,968 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:38,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:53:38,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:38,969 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:38,969 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-20 08:53:38,969 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:38,970 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-20 08:53:38,970 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:53:38,970 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-20 08:53:38,970 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-20 08:53:38,970 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:53:38,970 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d. 2023-11-20 08:53:38,970 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d. started... 2023-11-20 08:53:38,971 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7accaa801f4702def28f4caede725b1d 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-20 08:53:39,021 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205ca17ba48adea48d3a93b4eee5cbb90bc to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205ca17ba48adea48d3a93b4eee5cbb90bc 2023-11-20 08:53:39,440 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/.tmp/family1/07056a6473404dd884b3154cd1263608 2023-11-20 08:53:39,451 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/.tmp/family1/07056a6473404dd884b3154cd1263608 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/07056a6473404dd884b3154cd1263608 2023-11-20 08:53:39,461 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/07056a6473404dd884b3154cd1263608, entries=1, sequenceid=17, filesize=5.0 K 2023-11-20 08:53:39,462 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7accaa801f4702def28f4caede725b1d in 491ms, sequenceid=17, compaction requested=true 2023-11-20 08:53:39,462 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7accaa801f4702def28f4caede725b1d: 2023-11-20 08:53:39,462 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d. 2023-11-20 08:53:39,463 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-20 08:53:39,463 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-20 08:53:39,463 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:39,463 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-20 08:53:39,463 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-20 08:53:39,466 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:39,466 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:39,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:39,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:53:39,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:53:39,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:53:39,467 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:39,467 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:53:39,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:53:39,469 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-11-20 08:53:39,471 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-11-20 08:53:39,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:39,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:39,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:53:39,475 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-20 08:53:39,475 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4cb6bfe0[Count = 0] remaining members to acquire global barrier 2023-11-20 08:53:39,475 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-20 08:53:39,475 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:39,478 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:39,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:39,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:39,478 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-20 08:53:39,478 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-20 08:53:39,478 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:53:39,478 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:39,478 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:53:39,481 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-20 08:53:39,481 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:39,481 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:53:39,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:39,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:53:39,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:53:39,481 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-20 08:53:39,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:53:39,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:53:39,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:39,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:39,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:53:39,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:39,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:39,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:53:39,486 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-20 08:53:39,486 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-20 08:53:39,486 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:53:39,486 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:53:39,486 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:39,486 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:53:39,491 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:39,491 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:39,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:39,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:39,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:53:39,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:53:39,491 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:53:39,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:39,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:53:39,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:53:39,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:53:39,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:39,492 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:39,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:39,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:53:39,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:39,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:39,495 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:39,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:53:39,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:39,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:39,500 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:39,501 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:39,501 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:53:39,501 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:39,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:53:39,501 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:53:39,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:53:39,501 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:39,501 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-20 08:53:39,501 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:53:39,501 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:39,501 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:39,501 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:53:39,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:53:39,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:53:39,501 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:39,502 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-20 08:53:39,502 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:53:39,602 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:53:39,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:53:39,612 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:53:39,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-20 08:53:39,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:39,614 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-20 08:53:39,614 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:53:39,615 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-20 08:53:39,615 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-20 08:53:39,616 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:39,616 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:39,617 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:53:39,617 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:39,617 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:53:39,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:53:39,618 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:39,618 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:53:39,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:39,619 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:39,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:53:39,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:39,619 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:39,619 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-20 08:53:39,619 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:39,619 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-20 08:53:39,619 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:53:39,620 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-20 08:53:39,620 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-20 08:53:39,620 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:53:39,620 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d. 2023-11-20 08:53:39,620 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d. started... 2023-11-20 08:53:39,620 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7accaa801f4702def28f4caede725b1d 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-20 08:53:40,046 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122816374ba23d2a4bdcb1988bedb24f26eb to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015122816374ba23d2a4bdcb1988bedb24f26eb 2023-11-20 08:53:40,218 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-20 08:53:40,459 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/.tmp/family1/ac6152dcd7d24da4aa5cf11d25479572 2023-11-20 08:53:40,469 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/.tmp/family1/ac6152dcd7d24da4aa5cf11d25479572 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/ac6152dcd7d24da4aa5cf11d25479572 2023-11-20 08:53:40,476 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/ac6152dcd7d24da4aa5cf11d25479572, entries=1, sequenceid=21, filesize=5.0 K 2023-11-20 08:53:40,477 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7accaa801f4702def28f4caede725b1d in 857ms, sequenceid=21, compaction requested=true 2023-11-20 08:53:40,478 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7accaa801f4702def28f4caede725b1d: 2023-11-20 08:53:40,478 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d. 2023-11-20 08:53:40,478 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-20 08:53:40,478 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-20 08:53:40,478 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:40,478 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-20 08:53:40,478 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-20 08:53:40,481 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:40,481 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:40,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:40,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:53:40,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:53:40,481 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:40,481 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:53:40,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:53:40,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:53:40,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:40,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:40,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:53:40,483 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-20 08:53:40,483 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@36bcd4c1[Count = 0] remaining members to acquire global barrier 2023-11-20 08:53:40,483 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-20 08:53:40,484 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:40,485 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:40,485 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:40,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:40,485 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-20 08:53:40,485 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-20 08:53:40,485 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:53:40,485 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:40,485 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:53:40,488 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-20 08:53:40,488 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:40,488 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:53:40,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:40,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:53:40,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:53:40,488 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-20 08:53:40,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:53:40,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:53:40,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:40,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:40,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:53:40,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:40,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:40,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:53:40,492 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-20 08:53:40,492 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-20 08:53:40,492 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:53:40,492 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:53:40,492 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:40,492 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:53:40,494 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:40,494 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:40,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:40,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:40,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:53:40,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:53:40,494 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:53:40,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:40,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:53:40,495 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:53:40,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:53:40,495 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:40,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:40,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:40,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:53:40,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:40,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:40,497 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:40,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:53:40,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:40,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:40,500 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:40,500 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:40,500 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:40,500 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:53:40,500 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:40,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:53:40,500 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:53:40,500 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-20 08:53:40,500 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:53:40,500 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-20 08:53:40,500 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:53:40,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:53:40,500 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:40,501 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:40,501 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-20 08:53:40,501 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:40,501 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:53:40,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:53:40,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:53:40,601 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:53:40,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:53:40,610 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:53:40,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-20 08:53:40,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:40,613 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-20 08:53:40,613 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:53:40,613 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-20 08:53:40,613 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-20 08:53:40,614 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:40,614 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:40,616 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:53:40,616 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:40,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:53:40,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:53:40,617 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:40,617 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:53:40,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:40,617 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:40,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:53:40,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:40,618 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:40,618 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-20 08:53:40,618 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:40,618 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-20 08:53:40,618 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:53:40,618 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-20 08:53:40,619 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-20 08:53:40,619 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:53:40,619 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d. 2023-11-20 08:53:40,619 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d. started... 2023-11-20 08:53:40,619 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7accaa801f4702def28f4caede725b1d 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-20 08:53:41,043 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512317ea3b120139e463998c5022bb3eefa4e to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512317ea3b120139e463998c5022bb3eefa4e 2023-11-20 08:53:41,135 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-11-20 08:53:41,136 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-11-20 08:53:41,454 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/.tmp/family1/ecd6361cf3d54706a47654c2970b5a61 2023-11-20 08:53:41,463 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/.tmp/family1/ecd6361cf3d54706a47654c2970b5a61 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/ecd6361cf3d54706a47654c2970b5a61 2023-11-20 08:53:41,471 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/ecd6361cf3d54706a47654c2970b5a61, entries=1, sequenceid=25, filesize=5.0 K 2023-11-20 08:53:41,473 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7accaa801f4702def28f4caede725b1d in 854ms, sequenceid=25, compaction requested=true 2023-11-20 08:53:41,473 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7accaa801f4702def28f4caede725b1d: 2023-11-20 08:53:41,473 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d. 2023-11-20 08:53:41,473 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-20 08:53:41,473 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-20 08:53:41,474 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:41,474 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-20 08:53:41,474 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-20 08:53:41,476 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:41,476 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:41,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:41,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:53:41,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:53:41,476 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:41,477 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:53:41,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:53:41,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:53:41,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:41,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:41,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:53:41,479 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-20 08:53:41,479 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@67ce610[Count = 0] remaining members to acquire global barrier 2023-11-20 08:53:41,479 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-20 08:53:41,479 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:41,481 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:41,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:41,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:41,481 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-20 08:53:41,481 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-20 08:53:41,481 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:53:41,481 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:41,481 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:53:41,483 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-20 08:53:41,483 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:41,483 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:53:41,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:41,484 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-20 08:53:41,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:53:41,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:53:41,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:53:41,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:53:41,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:41,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:41,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:53:41,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:41,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:41,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:53:41,488 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-20 08:53:41,488 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-20 08:53:41,488 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:53:41,488 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:53:41,488 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:41,488 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:53:41,490 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:41,490 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:41,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:41,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:41,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:53:41,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:53:41,490 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:53:41,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:41,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:53:41,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:53:41,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:53:41,491 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:41,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:41,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:41,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:53:41,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:41,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:41,494 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:41,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:53:41,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:41,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:41,497 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:41,498 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:41,498 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:53:41,498 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:41,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:53:41,498 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:53:41,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:53:41,498 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:53:41,498 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-20 08:53:41,498 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:41,498 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-20 08:53:41,499 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:53:41,499 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:41,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:53:41,499 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:41,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:53:41,499 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-20 08:53:41,499 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:41,499 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:53:41,600 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:53:41,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:53:41,609 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:53:41,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-20 08:53:41,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:41,612 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-20 08:53:41,612 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:53:41,613 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-20 08:53:41,613 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-20 08:53:41,613 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:41,613 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:41,616 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:53:41,616 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:41,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:53:41,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:53:41,617 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:41,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:41,617 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:53:41,618 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:41,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:53:41,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:41,619 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:41,620 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-20 08:53:41,620 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:41,620 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-20 08:53:41,620 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:53:41,621 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-20 08:53:41,624 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-20 08:53:41,624 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d. 2023-11-20 08:53:41,624 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:53:41,624 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d. started... 2023-11-20 08:53:41,624 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7accaa801f4702def28f4caede725b1d 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-20 08:53:42,048 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601015c577c29a51e48bd81fb70506d07d600 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601015c577c29a51e48bd81fb70506d07d600 2023-11-20 08:53:42,057 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/.tmp/family1/db474286b3a14d9ab5bd107bd3343a02 2023-11-20 08:53:42,064 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/.tmp/family1/db474286b3a14d9ab5bd107bd3343a02 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/db474286b3a14d9ab5bd107bd3343a02 2023-11-20 08:53:42,072 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/db474286b3a14d9ab5bd107bd3343a02, entries=1, sequenceid=29, filesize=5.0 K 2023-11-20 08:53:42,073 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7accaa801f4702def28f4caede725b1d in 449ms, sequenceid=29, compaction requested=true 2023-11-20 08:53:42,073 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7accaa801f4702def28f4caede725b1d: 2023-11-20 08:53:42,074 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d. 2023-11-20 08:53:42,074 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-20 08:53:42,074 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-20 08:53:42,074 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:42,074 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-20 08:53:42,074 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-20 08:53:42,080 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:42,080 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:42,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:42,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:53:42,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:53:42,080 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:42,080 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:53:42,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:53:42,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:53:42,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:42,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:42,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:53:42,082 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-20 08:53:42,082 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7f8db002[Count = 0] remaining members to acquire global barrier 2023-11-20 08:53:42,082 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-20 08:53:42,082 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:42,084 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:42,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:42,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:42,084 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-20 08:53:42,084 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-20 08:53:42,084 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:53:42,084 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:42,084 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:53:42,086 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-20 08:53:42,086 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:42,086 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:53:42,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:42,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:53:42,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:53:42,086 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-20 08:53:42,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:53:42,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:53:42,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:42,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:42,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:53:42,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:42,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:42,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:53:42,090 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-20 08:53:42,090 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-20 08:53:42,090 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:53:42,090 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:53:42,090 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:42,090 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:53:42,093 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:42,093 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:42,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:42,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:42,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:42,093 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:53:42,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:53:42,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:53:42,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:53:42,093 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:42,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:53:42,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:53:42,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:42,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:42,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:53:42,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:42,095 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:42,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:42,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:53:42,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:42,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:42,098 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:42,098 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:42,098 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:53:42,098 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:42,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:53:42,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:53:42,098 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:42,098 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-20 08:53:42,098 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:53:42,098 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:42,098 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:53:42,098 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:42,098 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:53:42,099 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-20 08:53:42,099 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:42,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:53:42,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:53:42,099 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-20 08:53:42,099 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:53:42,199 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:53:42,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:53:42,208 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:53:42,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-20 08:53:42,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:42,211 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-20 08:53:42,211 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:53:42,212 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-20 08:53:42,212 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-20 08:53:42,212 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:42,212 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:42,214 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:42,214 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:53:42,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:53:42,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:53:42,214 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:42,215 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:53:42,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:42,215 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:42,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:53:42,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:42,216 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:42,216 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-20 08:53:42,216 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:42,216 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-20 08:53:42,216 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:53:42,217 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-20 08:53:42,217 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-20 08:53:42,217 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:53:42,217 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d. 2023-11-20 08:53:42,217 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d. started... 2023-11-20 08:53:42,217 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7accaa801f4702def28f4caede725b1d 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-20 08:53:42,238 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601036f4fff7d84f9479691a732b885fbcd7e to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601036f4fff7d84f9479691a732b885fbcd7e 2023-11-20 08:53:42,676 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/.tmp/family1/f4b147c4c33b40a69f39d492ae810ba9 2023-11-20 08:53:42,684 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/.tmp/family1/f4b147c4c33b40a69f39d492ae810ba9 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/f4b147c4c33b40a69f39d492ae810ba9 2023-11-20 08:53:42,691 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/f4b147c4c33b40a69f39d492ae810ba9, entries=1, sequenceid=33, filesize=5.0 K 2023-11-20 08:53:42,692 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7accaa801f4702def28f4caede725b1d in 475ms, sequenceid=33, compaction requested=true 2023-11-20 08:53:42,692 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7accaa801f4702def28f4caede725b1d: 2023-11-20 08:53:42,692 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d. 2023-11-20 08:53:42,692 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-20 08:53:42,693 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-20 08:53:42,693 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:42,693 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-20 08:53:42,693 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-20 08:53:42,695 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:42,695 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:42,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:42,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:53:42,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:53:42,695 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:42,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:53:42,695 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:53:42,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:53:42,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:42,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:42,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:53:42,697 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-20 08:53:42,697 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@63d59ac[Count = 0] remaining members to acquire global barrier 2023-11-20 08:53:42,697 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-20 08:53:42,697 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:42,699 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:42,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:42,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:42,700 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-20 08:53:42,700 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-20 08:53:42,700 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:53:42,700 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:42,700 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:53:42,701 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-20 08:53:42,701 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:42,701 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:53:42,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:42,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:53:42,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:53:42,701 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-20 08:53:42,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:53:42,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:53:42,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:42,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:42,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:53:42,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:42,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:42,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:53:42,705 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-20 08:53:42,705 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-20 08:53:42,706 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:53:42,706 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:53:42,706 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:42,706 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:53:42,708 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:42,708 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:42,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:42,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:53:42,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:53:42,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:42,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:42,708 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:53:42,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:53:42,709 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:42,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:42,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:53:42,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:42,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:42,711 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:42,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:53:42,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:42,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:53:42,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:53:42,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:42,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:42,715 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:42,715 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:42,715 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:42,715 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:42,715 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:53:42,715 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:42,715 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:53:42,715 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:42,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:53:42,715 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:42,715 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:53:42,715 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-20 08:53:42,716 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:53:42,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:53:42,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:53:42,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:53:42,717 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-20 08:53:42,717 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:53:42,817 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:53:42,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:53:42,826 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:53:42,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-20 08:53:42,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:42,828 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-20 08:53:42,828 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:53:42,829 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-20 08:53:42,829 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-20 08:53:42,829 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:42,829 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:42,832 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:42,832 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:53:42,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:53:42,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:53:42,833 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:42,833 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:53:42,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:42,833 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:42,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:53:42,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:42,834 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:42,834 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-20 08:53:42,834 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:42,835 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-20 08:53:42,835 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:53:42,835 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-20 08:53:42,835 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-20 08:53:42,835 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:53:42,835 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d. 2023-11-20 08:53:42,835 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d. started... 2023-11-20 08:53:42,836 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7accaa801f4702def28f4caede725b1d 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-20 08:53:43,259 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907f4231a9edfd04992b304bb0246c49f8c to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20150907f4231a9edfd04992b304bb0246c49f8c 2023-11-20 08:53:43,268 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/.tmp/family1/31f10dcc571a47b580c46d01e2826215 2023-11-20 08:53:43,275 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/.tmp/family1/31f10dcc571a47b580c46d01e2826215 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/31f10dcc571a47b580c46d01e2826215 2023-11-20 08:53:43,281 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/31f10dcc571a47b580c46d01e2826215, entries=1, sequenceid=37, filesize=5.0 K 2023-11-20 08:53:43,283 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7accaa801f4702def28f4caede725b1d in 447ms, sequenceid=37, compaction requested=true 2023-11-20 08:53:43,283 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7accaa801f4702def28f4caede725b1d: 2023-11-20 08:53:43,283 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d. 2023-11-20 08:53:43,283 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-20 08:53:43,283 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-20 08:53:43,283 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:43,283 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-20 08:53:43,283 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-20 08:53:43,285 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:43,285 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:43,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:43,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:53:43,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:53:43,286 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:43,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:53:43,286 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:53:43,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:53:43,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:43,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:43,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:53:43,288 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-20 08:53:43,288 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@56f79f76[Count = 0] remaining members to acquire global barrier 2023-11-20 08:53:43,288 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-20 08:53:43,288 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:43,289 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:43,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:43,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:43,290 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-20 08:53:43,290 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-20 08:53:43,290 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:53:43,290 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:43,290 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:53:43,291 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:43,291 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-20 08:53:43,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:43,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:53:43,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:53:43,292 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:53:43,292 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-20 08:53:43,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:53:43,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:53:43,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:43,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:43,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:53:43,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:43,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:43,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:53:43,296 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-20 08:53:43,296 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-20 08:53:43,296 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:53:43,296 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:53:43,296 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:43,296 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:53:43,299 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:43,299 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:43,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:43,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:53:43,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:53:43,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:43,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:43,299 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:53:43,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:53:43,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:53:43,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:53:43,299 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:43,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:43,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:43,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:53:43,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:43,301 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:43,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:43,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:53:43,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:43,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:43,307 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:43,307 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:53:43,307 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:43,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:53:43,307 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:53:43,307 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:53:43,307 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-20 08:53:43,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:53:43,307 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-20 08:53:43,308 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:53:43,307 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:43,308 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:43,308 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:43,308 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:43,308 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:43,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:53:43,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:53:43,309 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-20 08:53:43,309 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:53:43,409 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:53:43,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:53:43,418 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:53:43,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-20 08:53:43,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:43,421 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-20 08:53:43,421 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:53:43,422 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-20 08:53:43,422 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-20 08:53:43,423 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:43,423 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:43,424 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:43,424 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:53:43,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:53:43,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:53:43,425 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:43,425 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:53:43,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:43,425 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:43,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:53:43,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:43,426 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:43,426 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-20 08:53:43,426 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:43,426 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-20 08:53:43,427 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:53:43,428 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-20 08:53:43,428 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-20 08:53:43,428 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:53:43,428 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d. 2023-11-20 08:53:43,428 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d. started... 2023-11-20 08:53:43,428 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7accaa801f4702def28f4caede725b1d 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-20 08:53:43,853 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511202d26b6dd0c4a4c07896f5db69bf60e14 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511202d26b6dd0c4a4c07896f5db69bf60e14 2023-11-20 08:53:44,262 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/.tmp/family1/b94826c595454f92a3aa24a5973ea107 2023-11-20 08:53:44,270 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/.tmp/family1/b94826c595454f92a3aa24a5973ea107 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/b94826c595454f92a3aa24a5973ea107 2023-11-20 08:53:44,277 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/b94826c595454f92a3aa24a5973ea107, entries=1, sequenceid=41, filesize=5.0 K 2023-11-20 08:53:44,278 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7accaa801f4702def28f4caede725b1d in 850ms, sequenceid=41, compaction requested=true 2023-11-20 08:53:44,278 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7accaa801f4702def28f4caede725b1d: 2023-11-20 08:53:44,279 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d. 2023-11-20 08:53:44,279 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-20 08:53:44,279 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-20 08:53:44,279 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:44,279 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-20 08:53:44,279 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-20 08:53:44,281 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:44,281 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:44,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:44,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:53:44,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:53:44,282 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:44,282 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:53:44,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:53:44,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:53:44,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:44,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:44,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:53:44,283 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-20 08:53:44,283 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@37daafde[Count = 0] remaining members to acquire global barrier 2023-11-20 08:53:44,283 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-20 08:53:44,284 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:44,285 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:44,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:44,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:44,285 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-20 08:53:44,285 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-20 08:53:44,285 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:53:44,285 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:44,285 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:53:44,287 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:44,287 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-20 08:53:44,287 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:53:44,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:44,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:53:44,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:53:44,287 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-20 08:53:44,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:53:44,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:53:44,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:44,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:44,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:53:44,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:44,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:44,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:53:44,291 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-20 08:53:44,291 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-20 08:53:44,291 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:53:44,291 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:53:44,291 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:44,291 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:53:44,293 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:44,293 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:53:44,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:44,293 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:44,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:44,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:44,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:53:44,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:53:44,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:53:44,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:53:44,294 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:44,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:53:44,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:44,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:44,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:53:44,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:44,296 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:44,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:44,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:53:44,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:44,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:44,299 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:44,299 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:44,299 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:53:44,299 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:44,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:53:44,299 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:53:44,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:53:44,299 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-20 08:53:44,299 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-20 08:53:44,299 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:53:44,299 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:44,299 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:53:44,299 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:44,299 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:44,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:53:44,299 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:44,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:53:44,300 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-20 08:53:44,300 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:53:44,400 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:53:44,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:53:44,406 DEBUG [Listener at localhost/43513] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-11-20 08:53:44,409 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34982, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-11-20 08:53:44,410 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=36169] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:44,422 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-20 08:53:44,423 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-20 08:53:44,424 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-20 08:53:44,424 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=12, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700471024424 2023-11-20 08:53:44,426 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-20 08:53:44,431 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-11-20 08:53:44,431 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-20 08:53:44,432 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] zookeeper.ReadOnlyZKClient(139): Connect 0x21650ac2 to 127.0.0.1:64635 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-20 08:53:44,438 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5d352949, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-20 08:53:44,440 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-20 08:53:44,915 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601039b4e5a8816604031ae108886e61c7ac0 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601039b4e5a8816604031ae108886e61c7ac0 2023-11-20 08:53:44,916 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-20 08:53:44,938 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-20 08:53:44,939 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41430, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-20 08:53:44,959 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-20 08:53:44,961 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34988, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-20 08:53:45,007 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/30c193443d5348cea0e1d619151d24ae first=Optional[r3] last=Optional[r6] 2023-11-20 08:53:45,023 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d., hostname=jenkins-hbase4.apache.org,38491,1700470412215, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/30c193443d5348cea0e1d619151d24ae}] 2023-11-20 08:53:45,050 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(763): Validating hfile at hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/30c193443d5348cea0e1d619151d24ae for inclusion in 7accaa801f4702def28f4caede725b1d/family1 2023-11-20 08:53:45,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-20 08:53:45,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(777): Region bounds: first= last= 2023-11-20 08:53:45,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HRegion(2446): Flush status journal for 7accaa801f4702def28f4caede725b1d: 2023-11-20 08:53:45,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/30c193443d5348cea0e1d619151d24ae to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__rdb2p73ntvmlij53rkn42v1ck3sb6dnep159inptk9mmoprf36dfgj618be2h1md/family1/30c193443d5348cea0e1d619151d24ae 2023-11-20 08:53:45,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__rdb2p73ntvmlij53rkn42v1ck3sb6dnep159inptk9mmoprf36dfgj618be2h1md/family1/30c193443d5348cea0e1d619151d24ae as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/9361b4e730c341c1a16284b4b2e183d0_SeqId_44_ 2023-11-20 08:53:45,070 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(849): Loaded HFile hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__rdb2p73ntvmlij53rkn42v1ck3sb6dnep159inptk9mmoprf36dfgj618be2h1md/family1/30c193443d5348cea0e1d619151d24ae into 7accaa801f4702def28f4caede725b1d/family1 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/9361b4e730c341c1a16284b4b2e183d0_SeqId_44_ - updating store file list. 2023-11-20 08:53:45,078 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(882): Loaded HFile hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/9361b4e730c341c1a16284b4b2e183d0_SeqId_44_ into 7accaa801f4702def28f4caede725b1d/family1 2023-11-20 08:53:45,079 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(855): Successfully loaded hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__rdb2p73ntvmlij53rkn42v1ck3sb6dnep159inptk9mmoprf36dfgj618be2h1md/family1/30c193443d5348cea0e1d619151d24ae into 7accaa801f4702def28f4caede725b1d/family1 (new location: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/9361b4e730c341c1a16284b4b2e183d0_SeqId_44_) 2023-11-20 08:53:45,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__rdb2p73ntvmlij53rkn42v1ck3sb6dnep159inptk9mmoprf36dfgj618be2h1md/family1/30c193443d5348cea0e1d619151d24ae 2023-11-20 08:53:45,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-20 08:53:45,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51357 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-20 08:53:45,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(1912): 7accaa801f4702def28f4caede725b1d/family1 is initiating minor compaction 2023-11-20 08:53:45,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@1e87817c; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-20 08:53:45,096 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 7accaa801f4702def28f4caede725b1d/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d. 2023-11-20 08:53:45,097 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/7f22bfc6cc844043aa8a6c95b5572294, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/48c3001028db4d3cbe5d5eba35b35922, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/07056a6473404dd884b3154cd1263608, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/ac6152dcd7d24da4aa5cf11d25479572, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/ecd6361cf3d54706a47654c2970b5a61, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/db474286b3a14d9ab5bd107bd3343a02, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/f4b147c4c33b40a69f39d492ae810ba9, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/31f10dcc571a47b580c46d01e2826215, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/b94826c595454f92a3aa24a5973ea107, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/9361b4e730c341c1a16284b4b2e183d0_SeqId_44_] into tmpdir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/.tmp, totalSize=50.2 K 2023-11-20 08:53:45,098 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting 7f22bfc6cc844043aa8a6c95b5572294, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-20 08:53:45,098 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting 48c3001028db4d3cbe5d5eba35b35922, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-20 08:53:45,098 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting 07056a6473404dd884b3154cd1263608, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-20 08:53:45,099 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting ac6152dcd7d24da4aa5cf11d25479572, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-20 08:53:45,099 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting ecd6361cf3d54706a47654c2970b5a61, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-20 08:53:45,099 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting db474286b3a14d9ab5bd107bd3343a02, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-20 08:53:45,099 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting f4b147c4c33b40a69f39d492ae810ba9, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-20 08:53:45,099 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting 31f10dcc571a47b580c46d01e2826215, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-20 08:53:45,099 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting b94826c595454f92a3aa24a5973ea107, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-20 08:53:45,099 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting 9361b4e730c341c1a16284b4b2e183d0_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-20 08:53:45,118 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-20 08:53:45,125 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:53:45,144 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015122816374ba23d2a4bdcb1988bedb24f26eb to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015122816374ba23d2a4bdcb1988bedb24f26eb 2023-11-20 08:53:45,147 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512317ea3b120139e463998c5022bb3eefa4e to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512317ea3b120139e463998c5022bb3eefa4e 2023-11-20 08:53:45,150 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601015c577c29a51e48bd81fb70506d07d600 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601015c577c29a51e48bd81fb70506d07d600 2023-11-20 08:53:45,152 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601036f4fff7d84f9479691a732b885fbcd7e to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601036f4fff7d84f9479691a732b885fbcd7e 2023-11-20 08:53:45,152 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 4 expired mob files are deleted 2023-11-20 08:53:45,152 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-20 08:53:45,153 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-20 08:53:45,153 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-20 08:53:45,153 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-20 08:53:45,153 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-20 08:53:45,153 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-20 08:53:45,153 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-20 08:53:45,153 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-20 08:53:45,154 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-20 08:53:45,206 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] throttle.PressureAwareThroughputController(145): 7accaa801f4702def28f4caede725b1d#family1#compaction#10 average throughput is 0.16 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-20 08:53:45,746 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512058ab8fdf48eea4d6485334750f354cc9f to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512058ab8fdf48eea4d6485334750f354cc9f 2023-11-20 08:53:45,748 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-20 08:53:45,782 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/051686ed50ee4aa68eaa1cfe2be623e0 first=Optional[r00] last=Optional[r2] 2023-11-20 08:53:45,783 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d., hostname=jenkins-hbase4.apache.org,38491,1700470412215, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/051686ed50ee4aa68eaa1cfe2be623e0}] 2023-11-20 08:53:45,786 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(763): Validating hfile at hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/051686ed50ee4aa68eaa1cfe2be623e0 for inclusion in 7accaa801f4702def28f4caede725b1d/family1 2023-11-20 08:53:45,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-20 08:53:45,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(777): Region bounds: first= last= 2023-11-20 08:53:45,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HRegion(2446): Flush status journal for 7accaa801f4702def28f4caede725b1d: 2023-11-20 08:53:45,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/051686ed50ee4aa68eaa1cfe2be623e0 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__c5d3sremd51irtbil6qircrgrrc2fgpjq2ohj1tmod9hlbj7b0cjve64dp7sbs3h/family1/051686ed50ee4aa68eaa1cfe2be623e0 2023-11-20 08:53:45,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__c5d3sremd51irtbil6qircrgrrc2fgpjq2ohj1tmod9hlbj7b0cjve64dp7sbs3h/family1/051686ed50ee4aa68eaa1cfe2be623e0 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/84753c167fc84cf4825f1788c3698890_SeqId_46_ 2023-11-20 08:53:45,794 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(849): Loaded HFile hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__c5d3sremd51irtbil6qircrgrrc2fgpjq2ohj1tmod9hlbj7b0cjve64dp7sbs3h/family1/051686ed50ee4aa68eaa1cfe2be623e0 into 7accaa801f4702def28f4caede725b1d/family1 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/84753c167fc84cf4825f1788c3698890_SeqId_46_ - updating store file list. 2023-11-20 08:53:45,799 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(882): Loaded HFile hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/84753c167fc84cf4825f1788c3698890_SeqId_46_ into 7accaa801f4702def28f4caede725b1d/family1 2023-11-20 08:53:45,799 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(855): Successfully loaded hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__c5d3sremd51irtbil6qircrgrrc2fgpjq2ohj1tmod9hlbj7b0cjve64dp7sbs3h/family1/051686ed50ee4aa68eaa1cfe2be623e0 into 7accaa801f4702def28f4caede725b1d/family1 (new location: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/84753c167fc84cf4825f1788c3698890_SeqId_46_) 2023-11-20 08:53:45,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__c5d3sremd51irtbil6qircrgrrc2fgpjq2ohj1tmod9hlbj7b0cjve64dp7sbs3h/family1/051686ed50ee4aa68eaa1cfe2be623e0 2023-11-20 08:53:45,802 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-20 08:53:45,804 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:53:45,806 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511304f8382902ca846a0b48d4e58bd4dc325 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511304f8382902ca846a0b48d4e58bd4dc325 2023-11-20 08:53:45,807 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512012bc0e7575019491787fec10e37d04507 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512012bc0e7575019491787fec10e37d04507 2023-11-20 08:53:45,808 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205ca17ba48adea48d3a93b4eee5cbb90bc to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205ca17ba48adea48d3a93b4eee5cbb90bc 2023-11-20 08:53:45,808 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 3 expired mob files are deleted 2023-11-20 08:53:45,809 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-20 08:53:45,809 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-20 08:53:45,809 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-20 08:53:45,810 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-20 08:53:45,810 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=12, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-20 08:53:45,812 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 1.3950 sec 2023-11-20 08:53:45,967 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthly from 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-20 08:53:45,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure2.ProcedureExecutor(1028): Stored pid=13, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:45,989 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-11-20 08:53:45,991 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-11-20 08:53:45,991 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-11-20 08:53:45,995 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly}] 2023-11-20 08:53:46,007 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=7accaa801f4702def28f4caede725b1d, REOPEN/MOVE}] 2023-11-20 08:53:46,008 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=7accaa801f4702def28f4caede725b1d, REOPEN/MOVE 2023-11-20 08:53:46,009 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=7accaa801f4702def28f4caede725b1d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:46,010 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1700470426009"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700470426009"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700470426009"}]},"ts":"1700470426009"} 2023-11-20 08:53:46,012 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE; CloseRegionProcedure 7accaa801f4702def28f4caede725b1d, server=jenkins-hbase4.apache.org,38491,1700470412215}] 2023-11-20 08:53:46,054 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/.tmp/family1/16e68f9444fb4a9ea720526c671c9943 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/16e68f9444fb4a9ea720526c671c9943 2023-11-20 08:53:46,066 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 7accaa801f4702def28f4caede725b1d/family1 of 7accaa801f4702def28f4caede725b1d into 16e68f9444fb4a9ea720526c671c9943(size=6.6 K), total size for store is 358.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-20 08:53:46,066 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 7accaa801f4702def28f4caede725b1d: 2023-11-20 08:53:46,067 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d., storeName=family1, fileCount=10, fileSize=50.2 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.5 K), priority=2, time=1700470425091; duration=0sec 2023-11-20 08:53:46,068 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-20 08:53:46,111 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/7f22bfc6cc844043aa8a6c95b5572294, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/48c3001028db4d3cbe5d5eba35b35922, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/07056a6473404dd884b3154cd1263608, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/ac6152dcd7d24da4aa5cf11d25479572, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/ecd6361cf3d54706a47654c2970b5a61, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/db474286b3a14d9ab5bd107bd3343a02, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/f4b147c4c33b40a69f39d492ae810ba9, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/31f10dcc571a47b580c46d01e2826215, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/b94826c595454f92a3aa24a5973ea107, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/9361b4e730c341c1a16284b4b2e183d0_SeqId_44_] to archive 2023-11-20 08:53:46,113 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:53:46,115 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/7f22bfc6cc844043aa8a6c95b5572294 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/7f22bfc6cc844043aa8a6c95b5572294 2023-11-20 08:53:46,116 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/48c3001028db4d3cbe5d5eba35b35922 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/48c3001028db4d3cbe5d5eba35b35922 2023-11-20 08:53:46,118 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/07056a6473404dd884b3154cd1263608 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/07056a6473404dd884b3154cd1263608 2023-11-20 08:53:46,119 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/ac6152dcd7d24da4aa5cf11d25479572 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/ac6152dcd7d24da4aa5cf11d25479572 2023-11-20 08:53:46,121 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/ecd6361cf3d54706a47654c2970b5a61 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/ecd6361cf3d54706a47654c2970b5a61 2023-11-20 08:53:46,122 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/db474286b3a14d9ab5bd107bd3343a02 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/db474286b3a14d9ab5bd107bd3343a02 2023-11-20 08:53:46,123 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/f4b147c4c33b40a69f39d492ae810ba9 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/f4b147c4c33b40a69f39d492ae810ba9 2023-11-20 08:53:46,125 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/31f10dcc571a47b580c46d01e2826215 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/31f10dcc571a47b580c46d01e2826215 2023-11-20 08:53:46,126 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/b94826c595454f92a3aa24a5973ea107 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/b94826c595454f92a3aa24a5973ea107 2023-11-20 08:53:46,128 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/9361b4e730c341c1a16284b4b2e183d0_SeqId_44_ to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/9361b4e730c341c1a16284b4b2e183d0_SeqId_44_ 2023-11-20 08:53:46,170 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:46,172 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 7accaa801f4702def28f4caede725b1d 2023-11-20 08:53:46,173 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7accaa801f4702def28f4caede725b1d, disabling compactions & flushes 2023-11-20 08:53:46,173 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d. 2023-11-20 08:53:46,173 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d. 2023-11-20 08:53:46,173 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d. after waiting 0 ms 2023-11-20 08:53:46,173 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d. 2023-11-20 08:53:46,181 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/recovered.edits/49.seqid, newMaxSeqId=49, maxSeqId=1 2023-11-20 08:53:46,186 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d. 2023-11-20 08:53:46,186 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7accaa801f4702def28f4caede725b1d: 2023-11-20 08:53:46,186 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 7accaa801f4702def28f4caede725b1d to self. 2023-11-20 08:53:46,189 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 7accaa801f4702def28f4caede725b1d 2023-11-20 08:53:46,189 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=7accaa801f4702def28f4caede725b1d, regionState=CLOSED 2023-11-20 08:53:46,190 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1700470426189"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700470426189"}]},"ts":"1700470426189"} 2023-11-20 08:53:46,196 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=15 2023-11-20 08:53:46,196 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=15, state=SUCCESS; CloseRegionProcedure 7accaa801f4702def28f4caede725b1d, server=jenkins-hbase4.apache.org,38491,1700470412215 in 181 msec 2023-11-20 08:53:46,197 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=7accaa801f4702def28f4caede725b1d, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,38491,1700470412215; forceNewPlan=false, retain=true 2023-11-20 08:53:46,348 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=7accaa801f4702def28f4caede725b1d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:46,348 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1700470426348"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700470426348"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700470426348"}]},"ts":"1700470426348"} 2023-11-20 08:53:46,351 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=17, ppid=15, state=RUNNABLE; OpenRegionProcedure 7accaa801f4702def28f4caede725b1d, server=jenkins-hbase4.apache.org,38491,1700470412215}] 2023-11-20 08:53:46,504 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:46,508 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d. 2023-11-20 08:53:46,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7accaa801f4702def28f4caede725b1d, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d.', STARTKEY => '', ENDKEY => ''} 2023-11-20 08:53:46,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 7accaa801f4702def28f4caede725b1d 2023-11-20 08:53:46,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-20 08:53:46,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7accaa801f4702def28f4caede725b1d 2023-11-20 08:53:46,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7accaa801f4702def28f4caede725b1d 2023-11-20 08:53:46,511 INFO [StoreOpener-7accaa801f4702def28f4caede725b1d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 7accaa801f4702def28f4caede725b1d 2023-11-20 08:53:46,512 DEBUG [StoreOpener-7accaa801f4702def28f4caede725b1d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1 2023-11-20 08:53:46,512 DEBUG [StoreOpener-7accaa801f4702def28f4caede725b1d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1 2023-11-20 08:53:46,512 INFO [StoreOpener-7accaa801f4702def28f4caede725b1d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7accaa801f4702def28f4caede725b1d columnFamilyName family1 2023-11-20 08:53:46,520 DEBUG [StoreOpener-7accaa801f4702def28f4caede725b1d-1] regionserver.HStore(539): loaded hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/16e68f9444fb4a9ea720526c671c9943 2023-11-20 08:53:46,527 DEBUG [StoreOpener-7accaa801f4702def28f4caede725b1d-1] regionserver.HStore(539): loaded hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/84753c167fc84cf4825f1788c3698890_SeqId_46_ 2023-11-20 08:53:46,531 DEBUG [StoreOpener-7accaa801f4702def28f4caede725b1d-1] regionserver.HStore(539): loaded hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/fc3f3914c5ef477795b2737c77f117e5 2023-11-20 08:53:46,532 INFO [StoreOpener-7accaa801f4702def28f4caede725b1d-1] regionserver.HStore(310): Store=7accaa801f4702def28f4caede725b1d/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-20 08:53:46,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d 2023-11-20 08:53:46,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d 2023-11-20 08:53:46,539 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7accaa801f4702def28f4caede725b1d 2023-11-20 08:53:46,540 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7accaa801f4702def28f4caede725b1d; next sequenceid=50; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72740141, jitterRate=0.08391256630420685}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-20 08:53:46,540 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7accaa801f4702def28f4caede725b1d: 2023-11-20 08:53:46,541 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d., pid=17, masterSystemTime=1700470426504 2023-11-20 08:53:46,541 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-20 08:53:46,541 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-20 08:53:46,543 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 367249 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-20 08:53:46,543 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HStore(1912): 7accaa801f4702def28f4caede725b1d/family1 is initiating minor compaction (all files) 2023-11-20 08:53:46,543 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 7accaa801f4702def28f4caede725b1d/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d. 2023-11-20 08:53:46,543 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/fc3f3914c5ef477795b2737c77f117e5, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/16e68f9444fb4a9ea720526c671c9943, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/84753c167fc84cf4825f1788c3698890_SeqId_46_] into tmpdir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/.tmp, totalSize=358.6 K 2023-11-20 08:53:46,544 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d. 2023-11-20 08:53:46,544 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d. 2023-11-20 08:53:46,544 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting fc3f3914c5ef477795b2737c77f117e5, keycount=1000, bloomtype=ROW, size=175.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878836012 2023-11-20 08:53:46,545 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=7accaa801f4702def28f4caede725b1d, regionState=OPEN, openSeqNum=50, regionLocation=jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:46,545 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting 16e68f9444fb4a9ea720526c671c9943, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621236012 2023-11-20 08:53:46,545 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1700470426544"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700470426544"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700470426544"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700470426544"}]},"ts":"1700470426544"} 2023-11-20 08:53:46,545 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting 84753c167fc84cf4825f1788c3698890_SeqId_46_, keycount=1002, bloomtype=ROW, size=176.2 K, encoding=NONE, compression=NONE, seqNum=47, earliestPutTs=1448878836012 2023-11-20 08:53:46,549 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=17, resume processing ppid=15 2023-11-20 08:53:46,550 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=17, ppid=15, state=SUCCESS; OpenRegionProcedure 7accaa801f4702def28f4caede725b1d, server=jenkins-hbase4.apache.org,38491,1700470412215 in 196 msec 2023-11-20 08:53:46,552 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=14 2023-11-20 08:53:46,552 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=14, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=7accaa801f4702def28f4caede725b1d, REOPEN/MOVE in 543 msec 2023-11-20 08:53:46,557 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=14, resume processing ppid=13 2023-11-20 08:53:46,557 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=13, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 560 msec 2023-11-20 08:53:46,559 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=13, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 588 msec 2023-11-20 08:53:46,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=13 2023-11-20 08:53:46,572 INFO [Listener at localhost/43513] compactions.TestMobCompactor(278): alter status finished 2023-11-20 08:53:46,574 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=36169] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-20 08:53:46,576 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-20 08:53:46,577 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-20 08:53:46,578 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-20 08:53:46,578 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700471026578 2023-11-20 08:53:46,579 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-20 08:53:46,580 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-11-20 08:53:46,580 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-20 08:53:46,582 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] zookeeper.ReadOnlyZKClient(139): Connect 0x146262fb to 127.0.0.1:64635 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-20 08:53:46,584 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] throttle.PressureAwareThroughputController(145): 7accaa801f4702def28f4caede725b1d#family1#compaction#11 average throughput is 5.70 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-20 08:53:46,595 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4bed6019, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-20 08:53:46,595 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-20 08:53:46,595 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-20 08:53:46,595 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-20 08:53:46,595 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-20 08:53:46,595 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-20 08:53:46,612 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/.tmp/family1/2b0fca930fea4e2290551f3f8e6c5b9d as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/2b0fca930fea4e2290551f3f8e6c5b9d 2023-11-20 08:53:46,619 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 7accaa801f4702def28f4caede725b1d/family1 of 7accaa801f4702def28f4caede725b1d into 2b0fca930fea4e2290551f3f8e6c5b9d(size=177.2 K), total size for store is 177.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-20 08:53:46,619 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 7accaa801f4702def28f4caede725b1d: 2023-11-20 08:53:46,619 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d., storeName=7accaa801f4702def28f4caede725b1d/family1, priority=13, startTime=1700470426541; duration=0sec 2023-11-20 08:53:46,619 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-20 08:53:46,705 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/fc3f3914c5ef477795b2737c77f117e5, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/16e68f9444fb4a9ea720526c671c9943, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/84753c167fc84cf4825f1788c3698890_SeqId_46_] to archive 2023-11-20 08:53:46,706 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:53:46,708 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/fc3f3914c5ef477795b2737c77f117e5 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/fc3f3914c5ef477795b2737c77f117e5 2023-11-20 08:53:46,710 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/16e68f9444fb4a9ea720526c671c9943 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/16e68f9444fb4a9ea720526c671c9943 2023-11-20 08:53:46,712 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/84753c167fc84cf4825f1788c3698890_SeqId_46_ to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/84753c167fc84cf4825f1788c3698890_SeqId_46_ 2023-11-20 08:53:47,032 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128bbd11d1b13ab45d4b42a14ee394c4d15 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128bbd11d1b13ab45d4b42a14ee394c4d15 2023-11-20 08:53:47,033 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-20 08:53:47,046 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-20 08:53:47,048 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41436, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-20 08:53:47,058 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-20 08:53:47,060 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34990, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-20 08:53:47,078 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/4e9c4e76a7f941ef9101fe48ce513187 first=Optional[r05] last=Optional[r8] 2023-11-20 08:53:47,078 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d., hostname=jenkins-hbase4.apache.org,38491,1700470412215, seqNum=50 for row with hfile group [{family1,hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/4e9c4e76a7f941ef9101fe48ce513187}] 2023-11-20 08:53:47,088 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(763): Validating hfile at hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/4e9c4e76a7f941ef9101fe48ce513187 for inclusion in 7accaa801f4702def28f4caede725b1d/family1 2023-11-20 08:53:47,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-11-20 08:53:47,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(777): Region bounds: first= last= 2023-11-20 08:53:47,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HRegion(2446): Flush status journal for 7accaa801f4702def28f4caede725b1d: 2023-11-20 08:53:47,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/4e9c4e76a7f941ef9101fe48ce513187 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__s89qfh1csb8gsko602gkl3hjbosk87l842puol81icj5jkhgrk5ejr6nisksba3b/family1/4e9c4e76a7f941ef9101fe48ce513187 2023-11-20 08:53:47,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__s89qfh1csb8gsko602gkl3hjbosk87l842puol81icj5jkhgrk5ejr6nisksba3b/family1/4e9c4e76a7f941ef9101fe48ce513187 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/b2586e62f74f49edab453f8f69923396_SeqId_53_ 2023-11-20 08:53:47,098 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(849): Loaded HFile hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__s89qfh1csb8gsko602gkl3hjbosk87l842puol81icj5jkhgrk5ejr6nisksba3b/family1/4e9c4e76a7f941ef9101fe48ce513187 into 7accaa801f4702def28f4caede725b1d/family1 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/b2586e62f74f49edab453f8f69923396_SeqId_53_ - updating store file list. 2023-11-20 08:53:47,105 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(882): Loaded HFile hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/b2586e62f74f49edab453f8f69923396_SeqId_53_ into 7accaa801f4702def28f4caede725b1d/family1 2023-11-20 08:53:47,105 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(855): Successfully loaded hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__s89qfh1csb8gsko602gkl3hjbosk87l842puol81icj5jkhgrk5ejr6nisksba3b/family1/4e9c4e76a7f941ef9101fe48ce513187 into 7accaa801f4702def28f4caede725b1d/family1 (new location: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/family1/b2586e62f74f49edab453f8f69923396_SeqId_53_) 2023-11-20 08:53:47,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__s89qfh1csb8gsko602gkl3hjbosk87l842puol81icj5jkhgrk5ejr6nisksba3b/family1/4e9c4e76a7f941ef9101fe48ce513187 2023-11-20 08:53:47,109 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-20 08:53:47,110 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:53:47,112 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511202d26b6dd0c4a4c07896f5db69bf60e14 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511202d26b6dd0c4a4c07896f5db69bf60e14 2023-11-20 08:53:47,114 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112830f7fb4a355f4940b621737c0ccbd84a to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112830f7fb4a355f4940b621737c0ccbd84a 2023-11-20 08:53:47,114 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 2 expired mob files are deleted 2023-11-20 08:53:47,114 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-20 08:53:47,115 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-20 08:53:47,115 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-20 08:53:47,115 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-20 08:53:47,115 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-20 08:53:47,115 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-20 08:53:47,116 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-20 08:53:47,119 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 541 msec 2023-11-20 08:53:47,245 INFO [Listener at localhost/43513] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=252 (was 213) Potentially hanging thread: hconnection-0x79bab308-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x79bab308-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x60a986ba-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS:0;jenkins-hbase4:38491-shortCompactions-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:549) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64635@0x21650ac2-SendThread(127.0.0.1:64635) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:332) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1289) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1064588510_17 at /127.0.0.1:49016 [Waiting for operation #18] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1064588510_17 at /127.0.0.1:49068 [Waiting for operation #14] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x79bab308-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1064588510_17 at /127.0.0.1:49052 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64635@0x146262fb-SendThread(127.0.0.1:64635) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:332) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1289) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1064588510_17 at /127.0.0.1:49086 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_235196358_17 at /127.0.0.1:48960 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x60a986ba-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64635@0x21650ac2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$88/1629151255.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1064588510_17 at /127.0.0.1:34680 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x79bab308-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1064588510_17 at /127.0.0.1:49056 [Waiting for operation #22] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64635@0x146262fb sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$88/1629151255.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1064588510_17 at /127.0.0.1:49080 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x60a986ba-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1064588510_17 at /127.0.0.1:49032 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1064588510_17 at /127.0.0.1:49074 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1064588510_17 at /127.0.0.1:49102 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64635@0x146262fb-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:549) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1064588510_17 at /127.0.0.1:49194 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:316) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:373) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1064588510_17 at /127.0.0.1:49048 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1064588510_17 at /127.0.0.1:48986 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RSProcedureDispatcher-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x79bab308-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64635@0x21650ac2-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:549) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1064588510_17 at /127.0.0.1:49200 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobCompactor-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=624 (was 505) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=270 (was 266) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 170), AvailableMemoryMB=15160 (was 15485) 2023-11-20 08:53:47,261 INFO [Listener at localhost/43513] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=252, OpenFileDescriptor=624, MaxFileDescriptor=60000, SystemLoadAverage=270, ProcessCount=170, AvailableMemoryMB=15157 2023-11-20 08:53:47,264 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-20 08:53:47,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:47,268 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-20 08:53:47,268 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithMonthlyPolicy" procId is: 19 2023-11-20 08:53:47,269 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-20 08:53:47,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-20 08:53:47,271 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac 2023-11-20 08:53:47,271 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac empty. 2023-11-20 08:53:47,272 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac 2023-11-20 08:53:47,272 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithMonthlyPolicy regions 2023-11-20 08:53:47,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-20 08:53:47,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-20 08:53:47,682 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-20 08:53:47,684 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => a076e7cbdecd36f051362663494169ac, NAME => 'testMajorCompactionWithMonthlyPolicy,,1700470427264.a076e7cbdecd36f051362663494169ac.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp 2023-11-20 08:53:47,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-20 08:53:48,093 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1700470427264.a076e7cbdecd36f051362663494169ac.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-20 08:53:48,093 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing a076e7cbdecd36f051362663494169ac, disabling compactions & flushes 2023-11-20 08:53:48,093 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1700470427264.a076e7cbdecd36f051362663494169ac. 2023-11-20 08:53:48,093 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1700470427264.a076e7cbdecd36f051362663494169ac. 2023-11-20 08:53:48,093 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1700470427264.a076e7cbdecd36f051362663494169ac. after waiting 0 ms 2023-11-20 08:53:48,093 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1700470427264.a076e7cbdecd36f051362663494169ac. 2023-11-20 08:53:48,094 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1700470427264.a076e7cbdecd36f051362663494169ac. 2023-11-20 08:53:48,094 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for a076e7cbdecd36f051362663494169ac: 2023-11-20 08:53:48,097 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-20 08:53:48,099 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithMonthlyPolicy,,1700470427264.a076e7cbdecd36f051362663494169ac.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1700470428098"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700470428098"}]},"ts":"1700470428098"} 2023-11-20 08:53:48,101 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-20 08:53:48,102 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-20 08:53:48,102 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700470428102"}]},"ts":"1700470428102"} 2023-11-20 08:53:48,104 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-11-20 08:53:48,108 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=a076e7cbdecd36f051362663494169ac, ASSIGN}] 2023-11-20 08:53:48,110 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=a076e7cbdecd36f051362663494169ac, ASSIGN 2023-11-20 08:53:48,110 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=a076e7cbdecd36f051362663494169ac, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38491,1700470412215; forceNewPlan=false, retain=false 2023-11-20 08:53:48,261 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=a076e7cbdecd36f051362663494169ac, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:48,262 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithMonthlyPolicy,,1700470427264.a076e7cbdecd36f051362663494169ac.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1700470428261"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700470428261"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700470428261"}]},"ts":"1700470428261"} 2023-11-20 08:53:48,264 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure a076e7cbdecd36f051362663494169ac, server=jenkins-hbase4.apache.org,38491,1700470412215}] 2023-11-20 08:53:48,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-20 08:53:48,416 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:48,419 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithMonthlyPolicy,,1700470427264.a076e7cbdecd36f051362663494169ac. 2023-11-20 08:53:48,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a076e7cbdecd36f051362663494169ac, NAME => 'testMajorCompactionWithMonthlyPolicy,,1700470427264.a076e7cbdecd36f051362663494169ac.', STARTKEY => '', ENDKEY => ''} 2023-11-20 08:53:48,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithMonthlyPolicy a076e7cbdecd36f051362663494169ac 2023-11-20 08:53:48,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1700470427264.a076e7cbdecd36f051362663494169ac.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-20 08:53:48,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a076e7cbdecd36f051362663494169ac 2023-11-20 08:53:48,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a076e7cbdecd36f051362663494169ac 2023-11-20 08:53:48,421 INFO [StoreOpener-a076e7cbdecd36f051362663494169ac-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region a076e7cbdecd36f051362663494169ac 2023-11-20 08:53:48,423 DEBUG [StoreOpener-a076e7cbdecd36f051362663494169ac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1 2023-11-20 08:53:48,423 DEBUG [StoreOpener-a076e7cbdecd36f051362663494169ac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1 2023-11-20 08:53:48,424 INFO [StoreOpener-a076e7cbdecd36f051362663494169ac-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a076e7cbdecd36f051362663494169ac columnFamilyName family1 2023-11-20 08:53:48,425 INFO [StoreOpener-a076e7cbdecd36f051362663494169ac-1] regionserver.HStore(310): Store=a076e7cbdecd36f051362663494169ac/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-20 08:53:48,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac 2023-11-20 08:53:48,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac 2023-11-20 08:53:48,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a076e7cbdecd36f051362663494169ac 2023-11-20 08:53:48,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-20 08:53:48,432 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a076e7cbdecd36f051362663494169ac; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63107870, jitterRate=-0.05961945652961731}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-20 08:53:48,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a076e7cbdecd36f051362663494169ac: 2023-11-20 08:53:48,433 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithMonthlyPolicy,,1700470427264.a076e7cbdecd36f051362663494169ac., pid=21, masterSystemTime=1700470428416 2023-11-20 08:53:48,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithMonthlyPolicy,,1700470427264.a076e7cbdecd36f051362663494169ac. 2023-11-20 08:53:48,435 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithMonthlyPolicy,,1700470427264.a076e7cbdecd36f051362663494169ac. 2023-11-20 08:53:48,436 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=a076e7cbdecd36f051362663494169ac, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:48,436 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithMonthlyPolicy,,1700470427264.a076e7cbdecd36f051362663494169ac.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1700470428436"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700470428436"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700470428436"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700470428436"}]},"ts":"1700470428436"} 2023-11-20 08:53:48,439 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=21, resume processing ppid=20 2023-11-20 08:53:48,439 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure a076e7cbdecd36f051362663494169ac, server=jenkins-hbase4.apache.org,38491,1700470412215 in 174 msec 2023-11-20 08:53:48,441 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=20, resume processing ppid=19 2023-11-20 08:53:48,441 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=20, ppid=19, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=a076e7cbdecd36f051362663494169ac, ASSIGN in 331 msec 2023-11-20 08:53:48,442 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-20 08:53:48,443 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700470428442"}]},"ts":"1700470428442"} 2023-11-20 08:53:48,444 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-11-20 08:53:48,446 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-20 08:53:48,448 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy in 1.1830 sec 2023-11-20 08:53:49,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-20 08:53:49,376 INFO [Listener at localhost/43513] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithMonthlyPolicy, procId: 19 completed 2023-11-20 08:53:49,408 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:53:49,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:49,410 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-20 08:53:49,410 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:53:49,410 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-20 08:53:49,410 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-20 08:53:49,411 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:49,411 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:49,413 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:49,413 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:53:49,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:53:49,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:53:49,414 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:49,414 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:53:49,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:49,415 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:49,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:53:49,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:49,415 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:49,415 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:49,415 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-20 08:53:49,415 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:53:49,416 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-20 08:53:49,416 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-20 08:53:49,416 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:53:49,416 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700470427264.a076e7cbdecd36f051362663494169ac. 2023-11-20 08:53:49,416 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700470427264.a076e7cbdecd36f051362663494169ac. started... 2023-11-20 08:53:49,417 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a076e7cbdecd36f051362663494169ac 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-20 08:53:49,844 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113042916f7e0bd849e79834ace598727505 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015113042916f7e0bd849e79834ace598727505 2023-11-20 08:53:50,248 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/.tmp/family1/74a25917f47243d78fa1a162a204b457 2023-11-20 08:53:50,255 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/.tmp/family1/74a25917f47243d78fa1a162a204b457 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/74a25917f47243d78fa1a162a204b457 2023-11-20 08:53:50,260 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/74a25917f47243d78fa1a162a204b457, entries=1000, sequenceid=5, filesize=166.0 K 2023-11-20 08:53:50,261 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for a076e7cbdecd36f051362663494169ac in 844ms, sequenceid=5, compaction requested=false 2023-11-20 08:53:50,261 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithMonthlyPolicy' 2023-11-20 08:53:50,262 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a076e7cbdecd36f051362663494169ac: 2023-11-20 08:53:50,262 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700470427264.a076e7cbdecd36f051362663494169ac. 2023-11-20 08:53:50,262 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-20 08:53:50,262 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-20 08:53:50,262 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:50,262 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-20 08:53:50,262 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-20 08:53:50,264 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:50,264 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:50,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:50,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:53:50,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:53:50,265 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:50,265 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:53:50,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:53:50,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:53:50,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:50,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:50,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:53:50,266 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-20 08:53:50,267 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@25451487[Count = 0] remaining members to acquire global barrier 2023-11-20 08:53:50,267 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-20 08:53:50,267 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:50,268 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:50,268 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:50,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:50,268 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-20 08:53:50,268 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-20 08:53:50,268 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:53:50,268 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:50,268 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:53:50,270 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:50,270 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-20 08:53:50,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:50,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:53:50,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:53:50,270 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:53:50,270 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-20 08:53:50,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:53:50,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:53:50,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:50,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:50,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:53:50,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:50,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:50,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:53:50,273 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-20 08:53:50,273 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-20 08:53:50,273 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:53:50,273 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:53:50,273 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:50,273 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:53:50,276 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:50,276 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:50,276 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:53:50,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:50,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:53:50,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:53:50,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:50,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:50,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:53:50,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:53:50,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:53:50,277 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:50,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:50,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:50,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:53:50,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:50,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:50,278 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:50,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:53:50,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:50,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:50,283 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:50,284 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:50,284 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:53:50,284 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:50,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:53:50,284 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-20 08:53:50,284 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:53:50,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:53:50,284 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:53:50,284 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:50,284 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:53:50,284 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:50,285 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:50,285 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:50,285 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-20 08:53:50,285 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:53:50,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:53:50,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:53:50,385 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:53:50,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:53:50,392 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:53:50,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-20 08:53:50,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:50,393 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-20 08:53:50,393 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:53:50,394 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-20 08:53:50,394 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-20 08:53:50,394 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:50,395 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:50,396 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:50,396 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:53:50,396 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:53:50,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:53:50,396 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:50,396 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:53:50,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:50,397 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:50,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:53:50,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:50,397 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:50,397 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-20 08:53:50,398 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:50,398 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-20 08:53:50,398 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:53:50,398 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-20 08:53:50,398 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-20 08:53:50,398 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:53:50,398 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700470427264.a076e7cbdecd36f051362663494169ac. 2023-11-20 08:53:50,398 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700470427264.a076e7cbdecd36f051362663494169ac. started... 2023-11-20 08:53:50,399 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a076e7cbdecd36f051362663494169ac 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-20 08:53:50,815 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511288f95d6dcd7c946999f99c4929c75a7b5 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511288f95d6dcd7c946999f99c4929c75a7b5 2023-11-20 08:53:51,222 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/.tmp/family1/a132a52348684352a3cc9e55f9438260 2023-11-20 08:53:51,230 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/.tmp/family1/a132a52348684352a3cc9e55f9438260 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/a132a52348684352a3cc9e55f9438260 2023-11-20 08:53:51,240 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/a132a52348684352a3cc9e55f9438260, entries=1, sequenceid=9, filesize=5.0 K 2023-11-20 08:53:51,241 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for a076e7cbdecd36f051362663494169ac in 843ms, sequenceid=9, compaction requested=false 2023-11-20 08:53:51,242 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a076e7cbdecd36f051362663494169ac: 2023-11-20 08:53:51,242 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700470427264.a076e7cbdecd36f051362663494169ac. 2023-11-20 08:53:51,242 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-20 08:53:51,242 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-20 08:53:51,242 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:51,242 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-20 08:53:51,242 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-20 08:53:51,314 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:51,314 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:51,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:51,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:53:51,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:53:51,315 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:51,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:53:51,315 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:53:51,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:53:51,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:51,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:51,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:53:51,316 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-20 08:53:51,316 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4959d9ba[Count = 0] remaining members to acquire global barrier 2023-11-20 08:53:51,316 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-20 08:53:51,316 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:51,376 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:51,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:51,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:51,376 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-20 08:53:51,376 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-20 08:53:51,376 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:53:51,377 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:51,377 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:53:51,429 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-20 08:53:51,430 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:53:51,429 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:51,430 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-20 08:53:51,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:51,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:53:51,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:53:51,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:53:51,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:53:51,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:51,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:51,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:53:51,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:51,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:51,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:53:51,435 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-20 08:53:51,435 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-20 08:53:51,435 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:53:51,435 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:53:51,435 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:51,435 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:53:51,476 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:51,476 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:51,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:51,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:51,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:53:51,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:53:51,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:51,476 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:53:51,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:53:51,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:53:51,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:53:51,477 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:51,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:51,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:51,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:53:51,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:51,481 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:51,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:51,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:53:51,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:51,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:51,506 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:51,506 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:53:51,507 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:51,507 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:53:51,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:53:51,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:53:51,507 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:51,507 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:51,507 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:51,507 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:51,507 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:53:51,507 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-20 08:53:51,507 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:53:51,508 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-20 08:53:51,507 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:51,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:53:51,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:53:51,512 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-20 08:53:51,513 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:53:51,613 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:53:51,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:53:51,619 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:53:51,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-20 08:53:51,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:51,621 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-20 08:53:51,621 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:53:51,621 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-20 08:53:51,621 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-20 08:53:51,622 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:51,622 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:51,668 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:51,668 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:53:51,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:53:51,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:53:51,668 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:51,668 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:53:51,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:51,669 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:51,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:53:51,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:51,669 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:51,669 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-20 08:53:51,669 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:51,669 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-20 08:53:51,670 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:53:51,670 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-20 08:53:51,670 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-20 08:53:51,670 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:53:51,670 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700470427264.a076e7cbdecd36f051362663494169ac. 2023-11-20 08:53:51,670 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700470427264.a076e7cbdecd36f051362663494169ac. started... 2023-11-20 08:53:51,670 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a076e7cbdecd36f051362663494169ac 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-20 08:53:51,732 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-20 08:53:52,085 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201151a208c8e68484b86cbfc031176fe65 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201151a208c8e68484b86cbfc031176fe65 2023-11-20 08:53:52,491 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/.tmp/family1/9f1fb1b8fdd6418eb511db92f5eb02b0 2023-11-20 08:53:52,498 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/.tmp/family1/9f1fb1b8fdd6418eb511db92f5eb02b0 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/9f1fb1b8fdd6418eb511db92f5eb02b0 2023-11-20 08:53:52,503 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/9f1fb1b8fdd6418eb511db92f5eb02b0, entries=1, sequenceid=13, filesize=4.9 K 2023-11-20 08:53:52,504 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a076e7cbdecd36f051362663494169ac in 834ms, sequenceid=13, compaction requested=true 2023-11-20 08:53:52,505 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a076e7cbdecd36f051362663494169ac: 2023-11-20 08:53:52,505 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700470427264.a076e7cbdecd36f051362663494169ac. 2023-11-20 08:53:52,505 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-20 08:53:52,505 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-20 08:53:52,505 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:52,505 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-20 08:53:52,505 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-20 08:53:52,537 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:52,537 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:52,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:52,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:53:52,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:53:52,537 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:52,537 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:53:52,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:53:52,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:53:52,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:52,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:52,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:53:52,539 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-20 08:53:52,539 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@233fe3c8[Count = 0] remaining members to acquire global barrier 2023-11-20 08:53:52,539 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-20 08:53:52,539 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:52,575 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:52,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:52,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:52,576 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-20 08:53:52,576 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-20 08:53:52,576 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:53:52,576 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:52,576 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:53:52,606 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:52,606 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-20 08:53:52,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:52,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:53:52,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:53:52,606 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:53:52,607 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-20 08:53:52,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:53:52,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:53:52,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:52,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:52,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:53:52,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:52,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:52,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:53:52,610 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-20 08:53:52,610 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-20 08:53:52,610 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:53:52,610 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:53:52,610 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:52,610 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:53:52,660 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:52,660 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:52,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:52,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:52,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:53:52,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:53:52,660 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:53:52,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:52,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:53:52,661 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:52,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:53:52,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:53:52,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:52,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:52,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:53:52,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:52,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:52,663 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:52,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:53:52,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:52,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:52,691 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:52,691 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:53:52,691 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:52,691 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:53:52,691 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:52,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:53:52,691 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:53:52,691 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-20 08:53:52,692 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:53:52,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:53:52,691 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:52,692 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:52,692 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:52,692 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:52,692 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-20 08:53:52,693 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:53:52,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:53:52,693 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:53:52,793 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:53:52,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:53:52,800 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:53:52,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-20 08:53:52,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:52,804 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-20 08:53:52,804 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:53:52,804 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-20 08:53:52,804 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-20 08:53:52,805 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:52,805 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:52,822 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:53:52,822 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:52,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:53:52,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:53:52,822 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:52,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:52,822 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:53:52,823 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:52,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:53:52,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:52,823 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:52,823 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-20 08:53:52,824 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:52,824 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-20 08:53:52,824 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:53:52,824 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-20 08:53:52,824 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-20 08:53:52,824 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:53:52,824 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700470427264.a076e7cbdecd36f051362663494169ac. 2023-11-20 08:53:52,824 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700470427264.a076e7cbdecd36f051362663494169ac. started... 2023-11-20 08:53:52,825 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a076e7cbdecd36f051362663494169ac 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-20 08:53:53,243 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512059aa5b9f4b3534d5ea2a3a81dbf83eb43 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512059aa5b9f4b3534d5ea2a3a81dbf83eb43 2023-11-20 08:53:53,649 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/.tmp/family1/ea2eee2657f24724a2cad38e3e74fddb 2023-11-20 08:53:53,655 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/.tmp/family1/ea2eee2657f24724a2cad38e3e74fddb as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/ea2eee2657f24724a2cad38e3e74fddb 2023-11-20 08:53:53,660 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/ea2eee2657f24724a2cad38e3e74fddb, entries=1, sequenceid=17, filesize=4.9 K 2023-11-20 08:53:53,661 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a076e7cbdecd36f051362663494169ac in 836ms, sequenceid=17, compaction requested=true 2023-11-20 08:53:53,661 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a076e7cbdecd36f051362663494169ac: 2023-11-20 08:53:53,661 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700470427264.a076e7cbdecd36f051362663494169ac. 2023-11-20 08:53:53,661 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-20 08:53:53,661 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-20 08:53:53,661 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:53,661 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-20 08:53:53,661 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-20 08:53:53,663 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:53,663 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:53,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:53,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:53:53,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:53:53,663 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:53,664 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:53:53,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:53:53,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:53:53,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:53,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:53,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:53:53,665 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-20 08:53:53,665 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@41f90c2e[Count = 0] remaining members to acquire global barrier 2023-11-20 08:53:53,665 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-20 08:53:53,665 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:53,667 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:53,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:53,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:53,667 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-20 08:53:53,667 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-20 08:53:53,667 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:53:53,667 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:53,667 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:53:53,678 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-20 08:53:53,678 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:53,678 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:53:53,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:53,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:53:53,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:53:53,678 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-20 08:53:53,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:53:53,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:53:53,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:53,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:53,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:53:53,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:53,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:53,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:53:53,681 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-20 08:53:53,681 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-20 08:53:53,681 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:53:53,681 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:53:53,681 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:53,681 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:53:53,683 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:53,683 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:53,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:53,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:53,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:53:53,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:53:53,683 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:53:53,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:53,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:53:53,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:53:53,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:53:53,683 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:53,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:53,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:53,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:53:53,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:53,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:53,685 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:53,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:53:53,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:53,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:53,687 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:53,688 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:53,688 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:53:53,688 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:53:53,688 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:53,688 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:53:53,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:53:53,688 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:53,688 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-20 08:53:53,688 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:53:53,688 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:53,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:53:53,689 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:53,689 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:53,689 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-20 08:53:53,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:53:53,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:53:53,689 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:53:53,789 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:53:53,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:53:53,797 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:53:53,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-20 08:53:53,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:53,799 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-20 08:53:53,799 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:53:53,799 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-20 08:53:53,799 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-20 08:53:53,800 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:53,800 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:53,801 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:53:53,801 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:53:53,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:53:53,801 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:53,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:53,802 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:53,802 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:53:53,802 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:53,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:53:53,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:53,803 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:53,803 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-20 08:53:53,803 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:53,803 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-20 08:53:53,803 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:53:53,803 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-20 08:53:53,804 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-20 08:53:53,804 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:53:53,804 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700470427264.a076e7cbdecd36f051362663494169ac. 2023-11-20 08:53:53,804 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700470427264.a076e7cbdecd36f051362663494169ac. started... 2023-11-20 08:53:53,804 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a076e7cbdecd36f051362663494169ac 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-20 08:53:54,220 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228c3af0c30b14e48f3b2e8bae6087d4aeb to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228c3af0c30b14e48f3b2e8bae6087d4aeb 2023-11-20 08:53:54,626 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/.tmp/family1/309f0b738ca5463eb2df1cf42dab11b5 2023-11-20 08:53:54,632 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/.tmp/family1/309f0b738ca5463eb2df1cf42dab11b5 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/309f0b738ca5463eb2df1cf42dab11b5 2023-11-20 08:53:54,638 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/309f0b738ca5463eb2df1cf42dab11b5, entries=1, sequenceid=21, filesize=4.9 K 2023-11-20 08:53:54,639 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a076e7cbdecd36f051362663494169ac in 835ms, sequenceid=21, compaction requested=true 2023-11-20 08:53:54,639 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a076e7cbdecd36f051362663494169ac: 2023-11-20 08:53:54,639 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700470427264.a076e7cbdecd36f051362663494169ac. 2023-11-20 08:53:54,639 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-20 08:53:54,639 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-20 08:53:54,639 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:54,639 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-20 08:53:54,639 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-20 08:53:54,642 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:54,642 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:54,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:54,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:53:54,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:53:54,642 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:54,643 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:53:54,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:53:54,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:53:54,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:54,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:54,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:53:54,644 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-20 08:53:54,644 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4c15d9ba[Count = 0] remaining members to acquire global barrier 2023-11-20 08:53:54,644 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-20 08:53:54,644 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:54,645 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:54,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:54,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:54,645 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-20 08:53:54,646 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-20 08:53:54,646 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:53:54,646 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:54,646 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:53:54,647 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:54,647 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-20 08:53:54,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:54,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:53:54,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:53:54,647 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:53:54,647 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-20 08:53:54,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:53:54,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:53:54,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:54,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:54,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:53:54,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:54,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:54,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:53:54,650 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-20 08:53:54,650 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-20 08:53:54,650 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:53:54,650 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:53:54,651 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:54,651 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:53:54,652 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:54,652 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:54,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:54,653 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:53:54,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:54,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:54,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:53:54,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:53:54,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:53:54,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:53:54,653 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:54,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:53:54,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:54,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:54,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:53:54,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:54,655 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:54,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:54,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:53:54,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:54,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:54,660 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:54,660 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:53:54,660 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:53:54,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:53:54,660 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:54,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:53:54,660 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:54,660 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:54,660 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-20 08:53:54,660 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:53:54,660 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:54,660 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:53:54,660 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:54,660 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:54,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:53:54,661 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-20 08:53:54,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:53:54,661 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-20 08:53:54,661 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:53:54,761 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:53:54,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:53:54,769 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:53:54,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-20 08:53:54,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:54,771 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-20 08:53:54,771 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:53:54,772 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-20 08:53:54,772 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-20 08:53:54,773 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:54,773 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:54,774 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:53:54,774 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:54,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:53:54,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:53:54,774 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:54,775 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:53:54,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:54,775 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:54,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:53:54,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:54,775 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:54,776 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-20 08:53:54,776 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:54,776 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-20 08:53:54,776 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:53:54,776 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-20 08:53:54,777 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-20 08:53:54,777 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:53:54,777 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700470427264.a076e7cbdecd36f051362663494169ac. 2023-11-20 08:53:54,777 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700470427264.a076e7cbdecd36f051362663494169ac. started... 2023-11-20 08:53:54,777 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a076e7cbdecd36f051362663494169ac 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-20 08:53:55,205 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512311d5959b0671a482caa5c0adf8a4c8683 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512311d5959b0671a482caa5c0adf8a4c8683 2023-11-20 08:53:55,610 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/.tmp/family1/aab74eaca4cf4ac2bdb510b05533da73 2023-11-20 08:53:55,617 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/.tmp/family1/aab74eaca4cf4ac2bdb510b05533da73 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/aab74eaca4cf4ac2bdb510b05533da73 2023-11-20 08:53:55,621 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/aab74eaca4cf4ac2bdb510b05533da73, entries=1, sequenceid=25, filesize=4.9 K 2023-11-20 08:53:55,623 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a076e7cbdecd36f051362663494169ac in 846ms, sequenceid=25, compaction requested=true 2023-11-20 08:53:55,623 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a076e7cbdecd36f051362663494169ac: 2023-11-20 08:53:55,623 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700470427264.a076e7cbdecd36f051362663494169ac. 2023-11-20 08:53:55,623 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-20 08:53:55,623 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-20 08:53:55,623 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:55,623 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-20 08:53:55,623 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-20 08:53:55,625 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:55,625 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:55,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:55,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:53:55,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:53:55,625 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:55,625 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:53:55,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:53:55,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:53:55,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:55,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:55,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:53:55,627 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-20 08:53:55,627 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4b865d8b[Count = 0] remaining members to acquire global barrier 2023-11-20 08:53:55,627 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-20 08:53:55,627 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:55,628 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:55,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:55,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:55,628 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-20 08:53:55,628 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-20 08:53:55,628 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:53:55,628 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:55,629 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:53:55,630 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:55,630 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-20 08:53:55,630 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:53:55,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:55,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:53:55,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:53:55,630 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-20 08:53:55,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:53:55,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:53:55,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:55,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:55,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:53:55,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:55,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:55,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:53:55,633 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-20 08:53:55,633 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-20 08:53:55,633 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:53:55,633 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:53:55,633 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:55,633 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:53:55,635 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:55,635 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:55,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:55,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:53:55,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:53:55,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:55,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:55,635 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:53:55,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:53:55,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:53:55,635 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:55,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:53:55,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:55,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:55,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:53:55,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:55,637 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:55,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:55,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:53:55,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:55,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:55,640 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:55,640 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:55,640 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:53:55,640 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:55,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:53:55,640 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:55,640 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:55,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:53:55,641 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:53:55,640 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:53:55,641 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-20 08:53:55,641 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:53:55,641 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-20 08:53:55,640 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:55,641 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:55,641 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-20 08:53:55,641 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:53:55,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:53:55,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:53:55,741 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:53:55,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:53:55,748 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:53:55,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-20 08:53:55,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:55,750 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-20 08:53:55,750 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:53:55,751 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-20 08:53:55,751 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-20 08:53:55,751 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:55,751 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:55,753 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:55,753 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:53:55,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:53:55,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:53:55,753 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:55,753 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:53:55,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:55,754 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:55,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:53:55,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:55,754 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:55,754 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-20 08:53:55,754 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:55,754 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-20 08:53:55,754 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:53:55,755 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-20 08:53:55,755 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-20 08:53:55,755 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:53:55,755 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700470427264.a076e7cbdecd36f051362663494169ac. 2023-11-20 08:53:55,755 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700470427264.a076e7cbdecd36f051362663494169ac. started... 2023-11-20 08:53:55,755 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a076e7cbdecd36f051362663494169ac 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-20 08:53:56,170 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101724f4892633441aaa10333cb3bfe9c0c to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101724f4892633441aaa10333cb3bfe9c0c 2023-11-20 08:53:56,175 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/.tmp/family1/67aed906d6f4487b893df56a1494ac3c 2023-11-20 08:53:56,181 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/.tmp/family1/67aed906d6f4487b893df56a1494ac3c as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/67aed906d6f4487b893df56a1494ac3c 2023-11-20 08:53:56,187 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/67aed906d6f4487b893df56a1494ac3c, entries=1, sequenceid=29, filesize=4.9 K 2023-11-20 08:53:56,188 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a076e7cbdecd36f051362663494169ac in 433ms, sequenceid=29, compaction requested=true 2023-11-20 08:53:56,188 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a076e7cbdecd36f051362663494169ac: 2023-11-20 08:53:56,188 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700470427264.a076e7cbdecd36f051362663494169ac. 2023-11-20 08:53:56,188 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-20 08:53:56,188 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-20 08:53:56,188 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:56,188 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-20 08:53:56,188 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-20 08:53:56,193 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:56,193 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:56,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:56,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:53:56,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:53:56,194 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:56,194 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:53:56,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:53:56,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:53:56,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:56,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:56,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:53:56,195 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-20 08:53:56,195 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@17fbc690[Count = 0] remaining members to acquire global barrier 2023-11-20 08:53:56,195 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-20 08:53:56,195 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:56,197 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:56,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:56,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:56,197 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-20 08:53:56,197 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-20 08:53:56,197 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:53:56,197 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:56,197 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:53:56,198 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:56,198 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-20 08:53:56,199 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:53:56,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:56,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:53:56,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:53:56,199 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-20 08:53:56,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:53:56,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:53:56,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:56,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:56,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:53:56,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:56,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:56,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:53:56,202 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-20 08:53:56,202 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-20 08:53:56,202 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:53:56,202 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:53:56,202 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:56,202 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:53:56,204 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:56,204 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:56,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:56,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:53:56,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:53:56,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:56,204 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:53:56,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:56,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:53:56,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:53:56,205 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:56,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:53:56,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:56,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:56,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:53:56,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:56,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:56,208 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:56,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:53:56,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:56,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:56,212 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:56,212 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:53:56,212 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:56,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:53:56,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:53:56,212 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:53:56,212 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-20 08:53:56,212 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:53:56,212 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:53:56,212 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:56,212 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:56,213 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:56,213 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:56,213 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:56,213 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-20 08:53:56,213 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:53:56,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:53:56,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:53:56,313 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:53:56,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:53:56,321 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:53:56,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-20 08:53:56,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:56,323 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-20 08:53:56,323 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:53:56,324 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-20 08:53:56,324 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-20 08:53:56,324 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:56,324 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:56,326 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:56,326 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:53:56,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:53:56,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:53:56,326 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:56,326 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:53:56,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:56,327 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:56,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:53:56,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:56,327 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:56,328 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-20 08:53:56,328 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:56,328 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-20 08:53:56,328 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:53:56,328 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-20 08:53:56,329 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-20 08:53:56,329 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:53:56,329 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700470427264.a076e7cbdecd36f051362663494169ac. 2023-11-20 08:53:56,329 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700470427264.a076e7cbdecd36f051362663494169ac. started... 2023-11-20 08:53:56,329 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a076e7cbdecd36f051362663494169ac 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-20 08:53:56,752 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601033dfd783176cb4cf9803322b77b90a07a to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601033dfd783176cb4cf9803322b77b90a07a 2023-11-20 08:53:57,158 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/.tmp/family1/ed921fcdbdea41e8af4552a06f3e9cd8 2023-11-20 08:53:57,164 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/.tmp/family1/ed921fcdbdea41e8af4552a06f3e9cd8 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/ed921fcdbdea41e8af4552a06f3e9cd8 2023-11-20 08:53:57,169 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/ed921fcdbdea41e8af4552a06f3e9cd8, entries=1, sequenceid=33, filesize=4.9 K 2023-11-20 08:53:57,170 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a076e7cbdecd36f051362663494169ac in 841ms, sequenceid=33, compaction requested=true 2023-11-20 08:53:57,170 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a076e7cbdecd36f051362663494169ac: 2023-11-20 08:53:57,170 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700470427264.a076e7cbdecd36f051362663494169ac. 2023-11-20 08:53:57,170 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-20 08:53:57,170 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-20 08:53:57,170 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:57,170 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-20 08:53:57,170 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-20 08:53:57,172 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:57,172 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:57,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:53:57,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:53:57,173 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,173 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:53:57,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:53:57,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:53:57,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:57,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:53:57,174 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-20 08:53:57,175 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e6a303d[Count = 0] remaining members to acquire global barrier 2023-11-20 08:53:57,175 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-20 08:53:57,175 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,176 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,176 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-20 08:53:57,176 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-20 08:53:57,176 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:53:57,176 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:57,176 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:53:57,178 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-20 08:53:57,178 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:57,178 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:53:57,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:57,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:53:57,178 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-20 08:53:57,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:53:57,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:53:57,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:53:57,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:57,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:53:57,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:57,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:53:57,181 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-20 08:53:57,181 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-20 08:53:57,181 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:53:57,181 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:53:57,181 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,181 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:53:57,184 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,184 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:53:57,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:53:57,184 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:53:57,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:53:57,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:53:57,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:53:57,185 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:57,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:53:57,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:57,186 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:57,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:53:57,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:57,189 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:57,189 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,189 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:53:57,189 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,189 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:53:57,189 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-20 08:53:57,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:53:57,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:53:57,189 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:53:57,189 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:57,189 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-20 08:53:57,190 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:53:57,190 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,190 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:53:57,190 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:53:57,190 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-20 08:53:57,190 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:53:57,290 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:53:57,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:53:57,297 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:53:57,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-20 08:53:57,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,300 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-20 08:53:57,300 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:53:57,300 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-20 08:53:57,300 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-20 08:53:57,301 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,301 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,302 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:53:57,302 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:57,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:53:57,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:53:57,303 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:57,303 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:53:57,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,303 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:53:57,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,304 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,304 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-20 08:53:57,304 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,304 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-20 08:53:57,304 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:53:57,304 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-20 08:53:57,305 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-20 08:53:57,305 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:53:57,305 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700470427264.a076e7cbdecd36f051362663494169ac. 2023-11-20 08:53:57,305 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700470427264.a076e7cbdecd36f051362663494169ac. started... 2023-11-20 08:53:57,305 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a076e7cbdecd36f051362663494169ac 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-20 08:53:57,320 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509079876ded9b1ad4ac7a4bfc0c2d75ec953 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201509079876ded9b1ad4ac7a4bfc0c2d75ec953 2023-11-20 08:53:57,726 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/.tmp/family1/c32a3d2f3d904d0ab45c98a1581a98fd 2023-11-20 08:53:57,732 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/.tmp/family1/c32a3d2f3d904d0ab45c98a1581a98fd as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/c32a3d2f3d904d0ab45c98a1581a98fd 2023-11-20 08:53:57,738 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/c32a3d2f3d904d0ab45c98a1581a98fd, entries=1, sequenceid=37, filesize=4.9 K 2023-11-20 08:53:57,739 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a076e7cbdecd36f051362663494169ac in 434ms, sequenceid=37, compaction requested=true 2023-11-20 08:53:57,739 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a076e7cbdecd36f051362663494169ac: 2023-11-20 08:53:57,739 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700470427264.a076e7cbdecd36f051362663494169ac. 2023-11-20 08:53:57,739 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-20 08:53:57,739 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-20 08:53:57,739 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:57,739 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-20 08:53:57,739 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-20 08:53:57,742 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:57,742 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:57,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:53:57,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:53:57,743 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,743 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:53:57,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:53:57,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:53:57,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:57,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:53:57,745 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-20 08:53:57,745 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7cd0f243[Count = 0] remaining members to acquire global barrier 2023-11-20 08:53:57,745 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-20 08:53:57,745 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,746 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,746 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-20 08:53:57,746 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-20 08:53:57,746 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:53:57,746 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:57,746 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:53:57,748 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:57,748 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-20 08:53:57,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:57,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:53:57,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:53:57,748 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:53:57,748 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-20 08:53:57,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:53:57,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:53:57,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:57,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:53:57,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:57,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:53:57,751 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-20 08:53:57,751 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-20 08:53:57,751 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:53:57,751 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:53:57,751 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,751 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:53:57,753 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,753 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,753 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:53:57,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:53:57,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:53:57,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:53:57,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:53:57,754 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:57,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:53:57,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:53:57,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,755 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:57,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:57,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:53:57,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:57,763 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:57,763 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,763 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:53:57,763 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,763 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:53:57,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:53:57,763 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-20 08:53:57,763 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-20 08:53:57,763 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:53:57,763 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:53:57,763 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:57,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:53:57,764 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,764 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,764 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-20 08:53:57,764 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,764 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:53:57,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:53:57,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:53:57,864 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:53:57,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:53:57,871 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:53:57,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-20 08:53:57,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,873 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-20 08:53:57,873 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:53:57,874 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-20 08:53:57,874 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-20 08:53:57,874 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,874 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,877 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:53:57,877 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:57,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:53:57,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:53:57,877 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:57,877 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:53:57,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,878 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:53:57,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,878 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,879 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-20 08:53:57,879 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,879 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-20 08:53:57,879 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:53:57,880 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-20 08:53:57,880 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-20 08:53:57,880 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:53:57,880 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700470427264.a076e7cbdecd36f051362663494169ac. 2023-11-20 08:53:57,880 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700470427264.a076e7cbdecd36f051362663494169ac. started... 2023-11-20 08:53:57,880 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a076e7cbdecd36f051362663494169ac 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-20 08:53:57,895 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120bd18205173084aeda77c9997ddae3bdb to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120bd18205173084aeda77c9997ddae3bdb 2023-11-20 08:53:57,902 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/.tmp/family1/28d78000796d4fa3b9e391b72770e658 2023-11-20 08:53:57,908 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/.tmp/family1/28d78000796d4fa3b9e391b72770e658 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/28d78000796d4fa3b9e391b72770e658 2023-11-20 08:53:57,914 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/28d78000796d4fa3b9e391b72770e658, entries=1, sequenceid=41, filesize=4.9 K 2023-11-20 08:53:57,915 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a076e7cbdecd36f051362663494169ac in 35ms, sequenceid=41, compaction requested=true 2023-11-20 08:53:57,915 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a076e7cbdecd36f051362663494169ac: 2023-11-20 08:53:57,915 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700470427264.a076e7cbdecd36f051362663494169ac. 2023-11-20 08:53:57,915 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-20 08:53:57,915 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-20 08:53:57,915 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:57,916 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-20 08:53:57,916 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-20 08:53:57,917 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:57,917 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:57,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:53:57,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:53:57,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:53:57,918 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,918 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:53:57,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:53:57,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:57,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:53:57,920 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-20 08:53:57,920 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5438257[Count = 0] remaining members to acquire global barrier 2023-11-20 08:53:57,920 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-20 08:53:57,920 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,921 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,922 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,922 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-20 08:53:57,922 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-20 08:53:57,922 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:53:57,922 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:57,922 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:53:57,923 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:57,923 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-20 08:53:57,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:57,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:53:57,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:53:57,924 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:53:57,924 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-20 08:53:57,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:53:57,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:53:57,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:57,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:53:57,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:57,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:53:57,928 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-20 08:53:57,928 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-20 08:53:57,928 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:53:57,928 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:53:57,928 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,928 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:53:57,930 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,930 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:53:57,930 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:53:57,930 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:53:57,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:53:57,930 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:53:57,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:53:57,930 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:57,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:53:57,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:57,932 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:57,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:53:57,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:57,934 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:57,934 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,934 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:53:57,934 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:53:57,935 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:53:57,935 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:53:57,935 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:53:57,936 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:53:57,935 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-20 08:53:57,936 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:53:57,936 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,936 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:57,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:53:57,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:53:57,936 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-20 08:53:57,936 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:53:58,037 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:53:58,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:53:58,040 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=36169] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithMonthlyPolicy 2023-11-20 08:53:58,042 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] procedure2.ProcedureExecutor(1028): Stored pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-20 08:53:58,043 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-20 08:53:58,044 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-20 08:53:58,044 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=22, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700471038044 2023-11-20 08:53:58,045 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-20 08:53:58,047 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithMonthlyPolicy' and column 'family1' 2023-11-20 08:53:58,047 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-20 08:53:58,048 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] zookeeper.ReadOnlyZKClient(139): Connect 0x3a667848 to 127.0.0.1:64635 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-20 08:53:58,053 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1a2b3ab5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-20 08:53:58,053 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-20 08:53:58,499 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601038052eedec8ab43baba7f56dad58ab7aa to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601038052eedec8ab43baba7f56dad58ab7aa 2023-11-20 08:53:58,500 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-20 08:53:58,514 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-20 08:53:58,515 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40688, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-20 08:53:58,523 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-20 08:53:58,525 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37600, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-20 08:53:58,535 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/54e2cdce839e4ba5b4ef7c5724a3876a first=Optional[r5] last=Optional[r6] 2023-11-20 08:53:58,536 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1700470427264.a076e7cbdecd36f051362663494169ac., hostname=jenkins-hbase4.apache.org,38491,1700470412215, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/54e2cdce839e4ba5b4ef7c5724a3876a}] 2023-11-20 08:53:58,540 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(763): Validating hfile at hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/54e2cdce839e4ba5b4ef7c5724a3876a for inclusion in a076e7cbdecd36f051362663494169ac/family1 2023-11-20 08:53:58,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-11-20 08:53:58,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(777): Region bounds: first= last= 2023-11-20 08:53:58,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HRegion(2446): Flush status journal for a076e7cbdecd36f051362663494169ac: 2023-11-20 08:53:58,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/54e2cdce839e4ba5b4ef7c5724a3876a to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionWithMonthlyPolicy__duc9c9pe5fg0r88o10imilcb0k372o64uaqnmsvg2la8kb3ovrr93jc5vt8qoel2/family1/54e2cdce839e4ba5b4ef7c5724a3876a 2023-11-20 08:53:58,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionWithMonthlyPolicy__duc9c9pe5fg0r88o10imilcb0k372o64uaqnmsvg2la8kb3ovrr93jc5vt8qoel2/family1/54e2cdce839e4ba5b4ef7c5724a3876a as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/020da19e51d8495ba1c9125e711df732_SeqId_44_ 2023-11-20 08:53:58,547 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(849): Loaded HFile hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionWithMonthlyPolicy__duc9c9pe5fg0r88o10imilcb0k372o64uaqnmsvg2la8kb3ovrr93jc5vt8qoel2/family1/54e2cdce839e4ba5b4ef7c5724a3876a into a076e7cbdecd36f051362663494169ac/family1 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/020da19e51d8495ba1c9125e711df732_SeqId_44_ - updating store file list. 2023-11-20 08:53:58,552 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(882): Loaded HFile hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/020da19e51d8495ba1c9125e711df732_SeqId_44_ into a076e7cbdecd36f051362663494169ac/family1 2023-11-20 08:53:58,552 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(855): Successfully loaded hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionWithMonthlyPolicy__duc9c9pe5fg0r88o10imilcb0k372o64uaqnmsvg2la8kb3ovrr93jc5vt8qoel2/family1/54e2cdce839e4ba5b4ef7c5724a3876a into a076e7cbdecd36f051362663494169ac/family1 (new location: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/020da19e51d8495ba1c9125e711df732_SeqId_44_) 2023-11-20 08:53:58,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionWithMonthlyPolicy__duc9c9pe5fg0r88o10imilcb0k372o64uaqnmsvg2la8kb3ovrr93jc5vt8qoel2/family1/54e2cdce839e4ba5b4ef7c5724a3876a 2023-11-20 08:53:58,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-20 08:53:58,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-20 08:53:58,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(1912): a076e7cbdecd36f051362663494169ac/family1 is initiating minor compaction 2023-11-20 08:53:58,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@4663427b; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-20 08:53:58,557 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of a076e7cbdecd36f051362663494169ac/family1 in testMajorCompactionWithMonthlyPolicy,,1700470427264.a076e7cbdecd36f051362663494169ac. 2023-11-20 08:53:58,557 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/a132a52348684352a3cc9e55f9438260, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/9f1fb1b8fdd6418eb511db92f5eb02b0, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/ea2eee2657f24724a2cad38e3e74fddb, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/309f0b738ca5463eb2df1cf42dab11b5, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/aab74eaca4cf4ac2bdb510b05533da73, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/67aed906d6f4487b893df56a1494ac3c, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/ed921fcdbdea41e8af4552a06f3e9cd8, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/c32a3d2f3d904d0ab45c98a1581a98fd, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/28d78000796d4fa3b9e391b72770e658, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/020da19e51d8495ba1c9125e711df732_SeqId_44_] into tmpdir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/.tmp, totalSize=49.7 K 2023-11-20 08:53:58,558 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting a132a52348684352a3cc9e55f9438260, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-20 08:53:58,558 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting 9f1fb1b8fdd6418eb511db92f5eb02b0, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-20 08:53:58,558 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting ea2eee2657f24724a2cad38e3e74fddb, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-20 08:53:58,558 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting 309f0b738ca5463eb2df1cf42dab11b5, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-20 08:53:58,558 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting aab74eaca4cf4ac2bdb510b05533da73, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-20 08:53:58,558 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting 67aed906d6f4487b893df56a1494ac3c, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-20 08:53:58,558 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting ed921fcdbdea41e8af4552a06f3e9cd8, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-20 08:53:58,558 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting c32a3d2f3d904d0ab45c98a1581a98fd, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-20 08:53:58,558 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting 28d78000796d4fa3b9e391b72770e658, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-20 08:53:58,558 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting 020da19e51d8495ba1c9125e711df732_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-20 08:53:58,559 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-20 08:53:58,560 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:53:58,563 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101724f4892633441aaa10333cb3bfe9c0c to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101724f4892633441aaa10333cb3bfe9c0c 2023-11-20 08:53:58,564 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601033dfd783176cb4cf9803322b77b90a07a to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601033dfd783176cb4cf9803322b77b90a07a 2023-11-20 08:53:58,564 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-11-20 08:53:58,564 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-11-20 08:53:58,565 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-20 08:53:58,565 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-20 08:53:58,594 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] throttle.PressureAwareThroughputController(145): a076e7cbdecd36f051362663494169ac#family1#compaction#22 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-20 08:53:59,019 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231763edbcb5a444ee898e450fc602294fb to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231763edbcb5a444ee898e450fc602294fb 2023-11-20 08:53:59,020 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-20 08:53:59,051 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/1f10836940bf481083233ac60b2a5563 first=Optional[r1] last=Optional[r4] 2023-11-20 08:53:59,051 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1700470427264.a076e7cbdecd36f051362663494169ac., hostname=jenkins-hbase4.apache.org,38491,1700470412215, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/1f10836940bf481083233ac60b2a5563}] 2023-11-20 08:53:59,054 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(763): Validating hfile at hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/1f10836940bf481083233ac60b2a5563 for inclusion in a076e7cbdecd36f051362663494169ac/family1 2023-11-20 08:53:59,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-11-20 08:53:59,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(777): Region bounds: first= last= 2023-11-20 08:53:59,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HRegion(2446): Flush status journal for a076e7cbdecd36f051362663494169ac: 2023-11-20 08:53:59,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/1f10836940bf481083233ac60b2a5563 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionWithMonthlyPolicy__tjglus4rtnos93l3mur92dgtho013qntlk5jas0j2aa4kcp9i8cur0gkeq5jespr/family1/1f10836940bf481083233ac60b2a5563 2023-11-20 08:53:59,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionWithMonthlyPolicy__tjglus4rtnos93l3mur92dgtho013qntlk5jas0j2aa4kcp9i8cur0gkeq5jespr/family1/1f10836940bf481083233ac60b2a5563 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/cb1023a781c64a9b9e7937a5c68fac9f_SeqId_46_ 2023-11-20 08:53:59,062 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(849): Loaded HFile hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionWithMonthlyPolicy__tjglus4rtnos93l3mur92dgtho013qntlk5jas0j2aa4kcp9i8cur0gkeq5jespr/family1/1f10836940bf481083233ac60b2a5563 into a076e7cbdecd36f051362663494169ac/family1 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/cb1023a781c64a9b9e7937a5c68fac9f_SeqId_46_ - updating store file list. 2023-11-20 08:53:59,068 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(882): Loaded HFile hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/cb1023a781c64a9b9e7937a5c68fac9f_SeqId_46_ into a076e7cbdecd36f051362663494169ac/family1 2023-11-20 08:53:59,068 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(855): Successfully loaded hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionWithMonthlyPolicy__tjglus4rtnos93l3mur92dgtho013qntlk5jas0j2aa4kcp9i8cur0gkeq5jespr/family1/1f10836940bf481083233ac60b2a5563 into a076e7cbdecd36f051362663494169ac/family1 (new location: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/cb1023a781c64a9b9e7937a5c68fac9f_SeqId_46_) 2023-11-20 08:53:59,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionWithMonthlyPolicy__tjglus4rtnos93l3mur92dgtho013qntlk5jas0j2aa4kcp9i8cur0gkeq5jespr/family1/1f10836940bf481083233ac60b2a5563 2023-11-20 08:53:59,072 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-20 08:53:59,073 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:53:59,074 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201151a208c8e68484b86cbfc031176fe65 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201151a208c8e68484b86cbfc031176fe65 2023-11-20 08:53:59,075 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512059aa5b9f4b3534d5ea2a3a81dbf83eb43 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512059aa5b9f4b3534d5ea2a3a81dbf83eb43 2023-11-20 08:53:59,077 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228c3af0c30b14e48f3b2e8bae6087d4aeb to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228c3af0c30b14e48f3b2e8bae6087d4aeb 2023-11-20 08:53:59,078 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512311d5959b0671a482caa5c0adf8a4c8683 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512311d5959b0671a482caa5c0adf8a4c8683 2023-11-20 08:53:59,078 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-11-20 08:53:59,078 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-11-20 08:53:59,079 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-20 08:53:59,079 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-20 08:53:59,421 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/.tmp/family1/4eaa2648b0ba45618c8834a461dc83db as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/4eaa2648b0ba45618c8834a461dc83db 2023-11-20 08:53:59,428 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in a076e7cbdecd36f051362663494169ac/family1 of a076e7cbdecd36f051362663494169ac into 4eaa2648b0ba45618c8834a461dc83db(size=6.6 K), total size for store is 178.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-20 08:53:59,428 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for a076e7cbdecd36f051362663494169ac: 2023-11-20 08:53:59,428 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1700470427264.a076e7cbdecd36f051362663494169ac., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1700470438557; duration=0sec 2023-11-20 08:53:59,429 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-20 08:53:59,512 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/a132a52348684352a3cc9e55f9438260, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/9f1fb1b8fdd6418eb511db92f5eb02b0, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/ea2eee2657f24724a2cad38e3e74fddb, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/309f0b738ca5463eb2df1cf42dab11b5, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/aab74eaca4cf4ac2bdb510b05533da73, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/67aed906d6f4487b893df56a1494ac3c, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/ed921fcdbdea41e8af4552a06f3e9cd8, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/c32a3d2f3d904d0ab45c98a1581a98fd, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/28d78000796d4fa3b9e391b72770e658, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/020da19e51d8495ba1c9125e711df732_SeqId_44_] to archive 2023-11-20 08:53:59,514 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:53:59,516 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/a132a52348684352a3cc9e55f9438260 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/a132a52348684352a3cc9e55f9438260 2023-11-20 08:53:59,517 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/9f1fb1b8fdd6418eb511db92f5eb02b0 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/9f1fb1b8fdd6418eb511db92f5eb02b0 2023-11-20 08:53:59,519 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/ea2eee2657f24724a2cad38e3e74fddb to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/ea2eee2657f24724a2cad38e3e74fddb 2023-11-20 08:53:59,520 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/309f0b738ca5463eb2df1cf42dab11b5 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/309f0b738ca5463eb2df1cf42dab11b5 2023-11-20 08:53:59,522 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/aab74eaca4cf4ac2bdb510b05533da73 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/aab74eaca4cf4ac2bdb510b05533da73 2023-11-20 08:53:59,523 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/67aed906d6f4487b893df56a1494ac3c to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/67aed906d6f4487b893df56a1494ac3c 2023-11-20 08:53:59,524 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130c436da5a070346b8912fd60a53210d03 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130c436da5a070346b8912fd60a53210d03 2023-11-20 08:53:59,525 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/ed921fcdbdea41e8af4552a06f3e9cd8 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/ed921fcdbdea41e8af4552a06f3e9cd8 2023-11-20 08:53:59,525 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-20 08:53:59,526 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/c32a3d2f3d904d0ab45c98a1581a98fd to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/c32a3d2f3d904d0ab45c98a1581a98fd 2023-11-20 08:53:59,528 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/28d78000796d4fa3b9e391b72770e658 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/28d78000796d4fa3b9e391b72770e658 2023-11-20 08:53:59,529 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/020da19e51d8495ba1c9125e711df732_SeqId_44_ to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/020da19e51d8495ba1c9125e711df732_SeqId_44_ 2023-11-20 08:53:59,552 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/b795bcdbb69f4a12a1f9c8c7fce6ad36 first=Optional[r00] last=Optional[r8] 2023-11-20 08:53:59,553 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1700470427264.a076e7cbdecd36f051362663494169ac., hostname=jenkins-hbase4.apache.org,38491,1700470412215, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/b795bcdbb69f4a12a1f9c8c7fce6ad36}] 2023-11-20 08:53:59,555 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(763): Validating hfile at hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/b795bcdbb69f4a12a1f9c8c7fce6ad36 for inclusion in a076e7cbdecd36f051362663494169ac/family1 2023-11-20 08:53:59,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-11-20 08:53:59,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(777): Region bounds: first= last= 2023-11-20 08:53:59,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HRegion(2446): Flush status journal for a076e7cbdecd36f051362663494169ac: 2023-11-20 08:53:59,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/b795bcdbb69f4a12a1f9c8c7fce6ad36 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionWithMonthlyPolicy__o416nt2arc0juo3jvlcvl6vfl9an841ifkia19e7e02n6et75rrlvu5oj3lt2lrp/family1/b795bcdbb69f4a12a1f9c8c7fce6ad36 2023-11-20 08:53:59,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionWithMonthlyPolicy__o416nt2arc0juo3jvlcvl6vfl9an841ifkia19e7e02n6et75rrlvu5oj3lt2lrp/family1/b795bcdbb69f4a12a1f9c8c7fce6ad36 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/582ed139d65545e78819131148af5d00_SeqId_49_ 2023-11-20 08:53:59,565 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(849): Loaded HFile hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionWithMonthlyPolicy__o416nt2arc0juo3jvlcvl6vfl9an841ifkia19e7e02n6et75rrlvu5oj3lt2lrp/family1/b795bcdbb69f4a12a1f9c8c7fce6ad36 into a076e7cbdecd36f051362663494169ac/family1 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/582ed139d65545e78819131148af5d00_SeqId_49_ - updating store file list. 2023-11-20 08:53:59,570 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(882): Loaded HFile hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/582ed139d65545e78819131148af5d00_SeqId_49_ into a076e7cbdecd36f051362663494169ac/family1 2023-11-20 08:53:59,570 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(855): Successfully loaded hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionWithMonthlyPolicy__o416nt2arc0juo3jvlcvl6vfl9an841ifkia19e7e02n6et75rrlvu5oj3lt2lrp/family1/b795bcdbb69f4a12a1f9c8c7fce6ad36 into a076e7cbdecd36f051362663494169ac/family1 (new location: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/582ed139d65545e78819131148af5d00_SeqId_49_) 2023-11-20 08:53:59,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionWithMonthlyPolicy__o416nt2arc0juo3jvlcvl6vfl9an841ifkia19e7e02n6et75rrlvu5oj3lt2lrp/family1/b795bcdbb69f4a12a1f9c8c7fce6ad36 2023-11-20 08:53:59,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-20 08:53:59,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 352581 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-20 08:53:59,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(1912): a076e7cbdecd36f051362663494169ac/family1 is initiating minor compaction (all files) 2023-11-20 08:53:59,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@3cfd444d; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-20 08:53:59,573 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of a076e7cbdecd36f051362663494169ac/family1 in testMajorCompactionWithMonthlyPolicy,,1700470427264.a076e7cbdecd36f051362663494169ac. 2023-11-20 08:53:59,573 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/74a25917f47243d78fa1a162a204b457, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/4eaa2648b0ba45618c8834a461dc83db, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/cb1023a781c64a9b9e7937a5c68fac9f_SeqId_46_, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/582ed139d65545e78819131148af5d00_SeqId_49_] into tmpdir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/.tmp, totalSize=344.3 K 2023-11-20 08:53:59,573 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting 74a25917f47243d78fa1a162a204b457, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878836012 2023-11-20 08:53:59,574 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting 4eaa2648b0ba45618c8834a461dc83db, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621236012 2023-11-20 08:53:59,574 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting cb1023a781c64a9b9e7937a5c68fac9f_SeqId_46_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=47, earliestPutTs=1448965236012 2023-11-20 08:53:59,575 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-20 08:53:59,575 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting 582ed139d65545e78819131148af5d00_SeqId_49_, keycount=1001, bloomtype=ROW, size=166.2 K, encoding=NONE, compression=NONE, seqNum=50, earliestPutTs=1448014836012 2023-11-20 08:53:59,576 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:53:59,578 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120bd18205173084aeda77c9997ddae3bdb to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120bd18205173084aeda77c9997ddae3bdb 2023-11-20 08:53:59,579 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511288f95d6dcd7c946999f99c4929c75a7b5 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511288f95d6dcd7c946999f99c4929c75a7b5 2023-11-20 08:53:59,581 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015113042916f7e0bd849e79834ace598727505 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015113042916f7e0bd849e79834ace598727505 2023-11-20 08:53:59,581 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-11-20 08:53:59,581 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-20 08:53:59,581 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-20 08:53:59,582 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-20 08:53:59,582 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-20 08:53:59,582 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-20 08:53:59,582 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-20 08:53:59,583 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=22, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-20 08:53:59,585 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=22, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 1.5420 sec 2023-11-20 08:53:59,602 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] throttle.PressureAwareThroughputController(145): a076e7cbdecd36f051362663494169ac#family1#compaction#23 average throughput is 11.97 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-20 08:53:59,712 INFO [Listener at localhost/43513] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=267 (was 252) Potentially hanging thread: DataStreamer for file /user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/.tmp/family1/71569e20b75f4d4bbe85cd495449e6e6 block BP-981033928-172.31.14.131-1700470407596:blk_1073741900_1076 java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64635@0x3a667848-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:549) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1064588510_17 at /127.0.0.1:56206 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x369be31c-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64635@0x3a667848 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$88/1629151255.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x369be31c-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3dbf70ab-shared-pool-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64635@0x3a667848-SendThread(127.0.0.1:64635) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:332) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1289) Potentially hanging thread: hconnection-0x369be31c-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x369be31c-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1064588510_17 at /127.0.0.1:56312 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c2019f36-b591-93b3-961c-17512c63a77c/cluster_0312bc5e-93c7-79f4-9931-0016dabc1303/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1064588510_17 at /127.0.0.1:56378 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1064588510_17 at /127.0.0.1:56416 [Waiting for operation #14] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3dbf70ab-shared-pool-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_235196358_17 at /127.0.0.1:56334 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c2019f36-b591-93b3-961c-17512c63a77c/cluster_0312bc5e-93c7-79f4-9931-0016dabc1303/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1064588510_17 at /127.0.0.1:56404 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1064588510_17 at /127.0.0.1:56248 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_235196358_17 at /127.0.0.1:56472 [Receiving block BP-981033928-172.31.14.131-1700470407596:blk_1073741900_1076] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read1(BufferedInputStream.java:286) java.io.BufferedInputStream.read(BufferedInputStream.java:345) java.io.DataInputStream.read(DataInputStream.java:149) org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1064588510_17 at /127.0.0.1:56116 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1064588510_17 at /127.0.0.1:56410 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: PacketResponder: BP-981033928-172.31.14.131-1700470407596:blk_1073741900_1076, type=LAST_IN_PIPELINE java.lang.Object.wait(Native Method) java.lang.Object.wait(Object.java:502) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.waitForAckHead(BlockReceiver.java:1327) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.run(BlockReceiver.java:1399) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1064588510_17 at /127.0.0.1:56094 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1064588510_17 at /127.0.0.1:56242 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1064588510_17 at /127.0.0.1:56228 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1064588510_17 at /127.0.0.1:56292 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-492 java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: DataStreamer for file /user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511301f4c7ed208b44951a8de6c67f875382e_del java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1064588510_17 at /127.0.0.1:56460 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1064588510_17 at /127.0.0.1:56302 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1064588510_17 at /127.0.0.1:56174 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x369be31c-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x369be31c-shared-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1064588510_17 at /127.0.0.1:56386 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1064588510_17 at /127.0.0.1:56154 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x369be31c-shared-pool-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ResponseProcessor for block BP-981033928-172.31.14.131-1700470407596:blk_1073741900_1076 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:118) java.io.FilterInputStream.read(FilterInputStream.java:83) java.io.FilterInputStream.read(FilterInputStream.java:83) org.apache.hadoop.hdfs.protocolPB.PBHelperClient.vintPrefixed(PBHelperClient.java:454) org.apache.hadoop.hdfs.protocol.datatransfer.PipelineAck.readFields(PipelineAck.java:213) org.apache.hadoop.hdfs.DataStreamer$ResponseProcessor.run(DataStreamer.java:1080) - Thread LEAK? -, OpenFileDescriptor=652 (was 624) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=237 (was 270), ProcessCount=170 (was 170), AvailableMemoryMB=14998 (was 15157) 2023-11-20 08:53:59,725 INFO [Listener at localhost/43513] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=267, OpenFileDescriptor=652, MaxFileDescriptor=60000, SystemLoadAverage=237, ProcessCount=170, AvailableMemoryMB=14997 2023-11-20 08:53:59,728 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-20 08:53:59,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure2.ProcedureExecutor(1028): Stored pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy 2023-11-20 08:53:59,731 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-20 08:53:59,731 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithWeeklyPolicy" procId is: 23 2023-11-20 08:53:59,732 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-20 08:53:59,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-20 08:53:59,733 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7 2023-11-20 08:53:59,734 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7 empty. 2023-11-20 08:53:59,734 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7 2023-11-20 08:53:59,734 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithWeeklyPolicy regions 2023-11-20 08:53:59,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-20 08:54:00,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-20 08:54:00,144 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-20 08:54:00,146 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1b2f9409842f6bf16f1fa2b0c26e8da7, NAME => 'testMinorCompactionWithWeeklyPolicy,,1700470439728.1b2f9409842f6bf16f1fa2b0c26e8da7.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp 2023-11-20 08:54:00,162 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1700470439728.1b2f9409842f6bf16f1fa2b0c26e8da7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-20 08:54:00,162 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing 1b2f9409842f6bf16f1fa2b0c26e8da7, disabling compactions & flushes 2023-11-20 08:54:00,162 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1700470439728.1b2f9409842f6bf16f1fa2b0c26e8da7. 2023-11-20 08:54:00,162 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1700470439728.1b2f9409842f6bf16f1fa2b0c26e8da7. 2023-11-20 08:54:00,163 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1700470439728.1b2f9409842f6bf16f1fa2b0c26e8da7. after waiting 0 ms 2023-11-20 08:54:00,163 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1700470439728.1b2f9409842f6bf16f1fa2b0c26e8da7. 2023-11-20 08:54:00,163 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1700470439728.1b2f9409842f6bf16f1fa2b0c26e8da7. 2023-11-20 08:54:00,163 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 1b2f9409842f6bf16f1fa2b0c26e8da7: 2023-11-20 08:54:00,172 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-20 08:54:00,173 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithWeeklyPolicy,,1700470439728.1b2f9409842f6bf16f1fa2b0c26e8da7.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1700470440173"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700470440173"}]},"ts":"1700470440173"} 2023-11-20 08:54:00,175 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-20 08:54:00,176 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-20 08:54:00,176 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700470440176"}]},"ts":"1700470440176"} 2023-11-20 08:54:00,178 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-11-20 08:54:00,182 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=1b2f9409842f6bf16f1fa2b0c26e8da7, ASSIGN}] 2023-11-20 08:54:00,183 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=1b2f9409842f6bf16f1fa2b0c26e8da7, ASSIGN 2023-11-20 08:54:00,184 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=1b2f9409842f6bf16f1fa2b0c26e8da7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38491,1700470412215; forceNewPlan=false, retain=false 2023-11-20 08:54:00,335 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=1b2f9409842f6bf16f1fa2b0c26e8da7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:00,336 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithWeeklyPolicy,,1700470439728.1b2f9409842f6bf16f1fa2b0c26e8da7.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1700470440335"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700470440335"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700470440335"}]},"ts":"1700470440335"} 2023-11-20 08:54:00,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-20 08:54:00,337 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure 1b2f9409842f6bf16f1fa2b0c26e8da7, server=jenkins-hbase4.apache.org,38491,1700470412215}] 2023-11-20 08:54:00,489 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:00,492 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMinorCompactionWithWeeklyPolicy,,1700470439728.1b2f9409842f6bf16f1fa2b0c26e8da7. 2023-11-20 08:54:00,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1b2f9409842f6bf16f1fa2b0c26e8da7, NAME => 'testMinorCompactionWithWeeklyPolicy,,1700470439728.1b2f9409842f6bf16f1fa2b0c26e8da7.', STARTKEY => '', ENDKEY => ''} 2023-11-20 08:54:00,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithWeeklyPolicy 1b2f9409842f6bf16f1fa2b0c26e8da7 2023-11-20 08:54:00,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1700470439728.1b2f9409842f6bf16f1fa2b0c26e8da7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-20 08:54:00,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1b2f9409842f6bf16f1fa2b0c26e8da7 2023-11-20 08:54:00,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1b2f9409842f6bf16f1fa2b0c26e8da7 2023-11-20 08:54:00,494 INFO [StoreOpener-1b2f9409842f6bf16f1fa2b0c26e8da7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 1b2f9409842f6bf16f1fa2b0c26e8da7 2023-11-20 08:54:00,496 DEBUG [StoreOpener-1b2f9409842f6bf16f1fa2b0c26e8da7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1 2023-11-20 08:54:00,496 DEBUG [StoreOpener-1b2f9409842f6bf16f1fa2b0c26e8da7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1 2023-11-20 08:54:00,496 INFO [StoreOpener-1b2f9409842f6bf16f1fa2b0c26e8da7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1b2f9409842f6bf16f1fa2b0c26e8da7 columnFamilyName family1 2023-11-20 08:54:00,498 INFO [StoreOpener-1b2f9409842f6bf16f1fa2b0c26e8da7-1] regionserver.HStore(310): Store=1b2f9409842f6bf16f1fa2b0c26e8da7/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-20 08:54:00,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7 2023-11-20 08:54:00,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7 2023-11-20 08:54:00,502 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1b2f9409842f6bf16f1fa2b0c26e8da7 2023-11-20 08:54:00,504 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-20 08:54:00,504 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1b2f9409842f6bf16f1fa2b0c26e8da7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70228948, jitterRate=0.04649287462234497}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-20 08:54:00,504 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1b2f9409842f6bf16f1fa2b0c26e8da7: 2023-11-20 08:54:00,505 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMinorCompactionWithWeeklyPolicy,,1700470439728.1b2f9409842f6bf16f1fa2b0c26e8da7., pid=25, masterSystemTime=1700470440489 2023-11-20 08:54:00,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMinorCompactionWithWeeklyPolicy,,1700470439728.1b2f9409842f6bf16f1fa2b0c26e8da7. 2023-11-20 08:54:00,507 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMinorCompactionWithWeeklyPolicy,,1700470439728.1b2f9409842f6bf16f1fa2b0c26e8da7. 2023-11-20 08:54:00,507 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=1b2f9409842f6bf16f1fa2b0c26e8da7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:00,507 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithWeeklyPolicy,,1700470439728.1b2f9409842f6bf16f1fa2b0c26e8da7.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1700470440507"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700470440507"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700470440507"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700470440507"}]},"ts":"1700470440507"} 2023-11-20 08:54:00,511 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=24 2023-11-20 08:54:00,511 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure 1b2f9409842f6bf16f1fa2b0c26e8da7, server=jenkins-hbase4.apache.org,38491,1700470412215 in 172 msec 2023-11-20 08:54:00,513 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=23 2023-11-20 08:54:00,513 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=23, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=1b2f9409842f6bf16f1fa2b0c26e8da7, ASSIGN in 330 msec 2023-11-20 08:54:00,513 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-20 08:54:00,514 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700470440513"}]},"ts":"1700470440513"} 2023-11-20 08:54:00,515 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-11-20 08:54:00,518 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-20 08:54:00,519 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=23, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy in 790 msec 2023-11-20 08:54:00,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-20 08:54:00,837 INFO [Listener at localhost/43513] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithWeeklyPolicy, procId: 23 completed 2023-11-20 08:54:00,840 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/.tmp/family1/71569e20b75f4d4bbe85cd495449e6e6 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/71569e20b75f4d4bbe85cd495449e6e6 2023-11-20 08:54:00,846 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in a076e7cbdecd36f051362663494169ac/family1 of a076e7cbdecd36f051362663494169ac into 71569e20b75f4d4bbe85cd495449e6e6(size=167.4 K), total size for store is 167.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-20 08:54:00,846 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for a076e7cbdecd36f051362663494169ac: 2023-11-20 08:54:00,847 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1700470427264.a076e7cbdecd36f051362663494169ac., storeName=family1, fileCount=4, fileSize=344.3 K (166.0 K, 6.6 K, 5.5 K, 166.2 K), priority=2, time=1700470439572; duration=1sec 2023-11-20 08:54:00,847 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-20 08:54:00,864 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:54:00,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:00,865 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-20 08:54:00,865 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:00,865 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-20 08:54:00,865 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-20 08:54:00,866 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:00,866 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:00,867 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:00,867 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:00,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:00,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:00,868 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:00,868 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:54:00,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:00,868 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:00,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:54:00,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:00,868 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:00,869 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:00,869 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-20 08:54:00,869 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:00,869 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-20 08:54:00,869 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-20 08:54:00,869 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:54:00,869 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700470439728.1b2f9409842f6bf16f1fa2b0c26e8da7. 2023-11-20 08:54:00,869 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700470439728.1b2f9409842f6bf16f1fa2b0c26e8da7. started... 2023-11-20 08:54:00,870 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1b2f9409842f6bf16f1fa2b0c26e8da7 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-20 08:54:00,909 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/74a25917f47243d78fa1a162a204b457, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/4eaa2648b0ba45618c8834a461dc83db, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/cb1023a781c64a9b9e7937a5c68fac9f_SeqId_46_, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/582ed139d65545e78819131148af5d00_SeqId_49_] to archive 2023-11-20 08:54:00,910 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:54:00,912 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/74a25917f47243d78fa1a162a204b457 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/74a25917f47243d78fa1a162a204b457 2023-11-20 08:54:00,913 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/4eaa2648b0ba45618c8834a461dc83db to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/4eaa2648b0ba45618c8834a461dc83db 2023-11-20 08:54:00,914 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/cb1023a781c64a9b9e7937a5c68fac9f_SeqId_46_ to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/cb1023a781c64a9b9e7937a5c68fac9f_SeqId_46_ 2023-11-20 08:54:00,916 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/582ed139d65545e78819131148af5d00_SeqId_49_ to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/family1/582ed139d65545e78819131148af5d00_SeqId_49_ 2023-11-20 08:54:01,288 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511303cdef4474d774c0c9684541fe02378ec to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201511303cdef4474d774c0c9684541fe02378ec 2023-11-20 08:54:01,692 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/.tmp/family1/0c18e4de6ee3400484b7fd5c7c7b296a 2023-11-20 08:54:01,698 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/.tmp/family1/0c18e4de6ee3400484b7fd5c7c7b296a as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1/0c18e4de6ee3400484b7fd5c7c7b296a 2023-11-20 08:54:01,702 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1/0c18e4de6ee3400484b7fd5c7c7b296a, entries=1000, sequenceid=5, filesize=165.1 K 2023-11-20 08:54:01,703 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 1b2f9409842f6bf16f1fa2b0c26e8da7 in 833ms, sequenceid=5, compaction requested=false 2023-11-20 08:54:01,703 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithWeeklyPolicy' 2023-11-20 08:54:01,704 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1b2f9409842f6bf16f1fa2b0c26e8da7: 2023-11-20 08:54:01,704 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700470439728.1b2f9409842f6bf16f1fa2b0c26e8da7. 2023-11-20 08:54:01,704 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-20 08:54:01,704 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-20 08:54:01,704 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:01,704 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-20 08:54:01,704 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-20 08:54:01,706 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:01,706 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:01,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:01,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:01,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:01,707 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:01,707 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:54:01,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:01,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:01,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:01,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:01,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:01,708 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-20 08:54:01,708 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4cc50b29[Count = 0] remaining members to acquire global barrier 2023-11-20 08:54:01,708 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-20 08:54:01,708 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:01,710 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:01,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:01,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:01,710 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-20 08:54:01,710 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-20 08:54:01,710 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:54:01,710 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:01,710 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:54:01,712 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:01,712 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-20 08:54:01,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:01,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:01,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:01,712 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:01,712 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-20 08:54:01,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:01,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:01,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:01,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:01,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:01,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:01,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:01,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:54:01,715 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-20 08:54:01,715 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-20 08:54:01,715 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:54:01,715 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:54:01,715 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:01,715 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:54:01,718 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:01,718 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:01,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:01,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:01,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:01,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:01,718 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:01,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:01,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:01,719 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:01,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:01,719 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:01,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:01,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:01,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:01,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:01,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:01,720 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:01,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:01,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:01,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:01,723 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:01,723 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:01,723 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:01,723 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:01,723 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:01,723 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:01,723 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:01,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:01,723 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:01,723 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-20 08:54:01,723 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:54:01,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:01,723 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:01,723 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:01,723 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-20 08:54:01,723 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:54:01,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:01,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:01,824 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:54:01,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:54:01,829 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:54:01,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-20 08:54:01,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:01,830 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-20 08:54:01,830 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:01,830 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-20 08:54:01,830 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-20 08:54:01,831 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:01,831 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:01,832 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:01,832 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:01,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:01,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:01,833 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:01,833 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:54:01,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:01,833 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:01,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:54:01,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:01,834 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:01,834 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-20 08:54:01,834 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:01,834 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-20 08:54:01,834 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:01,834 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-20 08:54:01,834 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-20 08:54:01,834 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:54:01,834 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700470439728.1b2f9409842f6bf16f1fa2b0c26e8da7. 2023-11-20 08:54:01,834 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700470439728.1b2f9409842f6bf16f1fa2b0c26e8da7. started... 2023-11-20 08:54:01,834 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1b2f9409842f6bf16f1fa2b0c26e8da7 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-20 08:54:02,249 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128e1029d28802347a5a7553af7601cb7a6 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151128e1029d28802347a5a7553af7601cb7a6 2023-11-20 08:54:02,683 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/.tmp/family1/e609eb4f0e97467792492b06e381d3d0 2023-11-20 08:54:02,689 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/.tmp/family1/e609eb4f0e97467792492b06e381d3d0 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1/e609eb4f0e97467792492b06e381d3d0 2023-11-20 08:54:02,694 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1/e609eb4f0e97467792492b06e381d3d0, entries=1, sequenceid=9, filesize=5.0 K 2023-11-20 08:54:02,694 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 1b2f9409842f6bf16f1fa2b0c26e8da7 in 860ms, sequenceid=9, compaction requested=false 2023-11-20 08:54:02,695 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1b2f9409842f6bf16f1fa2b0c26e8da7: 2023-11-20 08:54:02,695 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700470439728.1b2f9409842f6bf16f1fa2b0c26e8da7. 2023-11-20 08:54:02,695 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-20 08:54:02,695 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-20 08:54:02,695 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:02,695 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-20 08:54:02,695 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-20 08:54:02,701 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:02,701 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:02,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:02,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:02,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:02,702 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:02,702 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:54:02,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:02,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:02,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:02,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:02,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:02,703 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-20 08:54:02,703 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3e13154[Count = 0] remaining members to acquire global barrier 2023-11-20 08:54:02,703 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-20 08:54:02,703 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:02,705 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:02,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:02,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:02,705 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-20 08:54:02,705 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-20 08:54:02,705 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:54:02,705 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:02,705 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:54:02,707 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:02,707 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-20 08:54:02,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:02,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:02,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:02,707 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:02,707 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-20 08:54:02,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:02,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:02,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:02,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:02,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:02,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:02,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:02,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:54:02,709 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-20 08:54:02,709 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-20 08:54:02,709 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:54:02,709 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:54:02,709 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:02,709 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:54:02,711 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:02,711 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:02,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:02,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:02,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:02,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:02,711 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:02,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:02,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:02,712 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:02,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:02,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:02,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:02,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:02,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:02,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:02,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:02,713 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:02,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:02,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:02,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:02,717 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:02,717 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:02,717 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:02,717 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:02,717 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-20 08:54:02,717 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:54:02,717 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:02,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:02,717 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:02,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:02,717 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:02,718 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:02,718 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-20 08:54:02,718 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:54:02,718 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:02,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:02,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:02,718 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:02,818 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:54:02,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:54:02,823 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:54:02,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-20 08:54:02,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:02,825 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-20 08:54:02,825 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:02,825 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-20 08:54:02,825 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-20 08:54:02,825 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:02,825 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:02,827 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:02,827 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:02,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:02,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:02,827 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:02,827 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:54:02,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:02,828 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:02,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:54:02,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:02,828 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:02,829 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-20 08:54:02,829 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:02,829 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-20 08:54:02,829 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:02,829 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-20 08:54:02,829 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-20 08:54:02,829 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:54:02,829 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700470439728.1b2f9409842f6bf16f1fa2b0c26e8da7. 2023-11-20 08:54:02,829 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700470439728.1b2f9409842f6bf16f1fa2b0c26e8da7. started... 2023-11-20 08:54:02,829 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1b2f9409842f6bf16f1fa2b0c26e8da7 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-20 08:54:02,842 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120160812b1e4e294680b55b2f904f9ce4e4 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120160812b1e4e294680b55b2f904f9ce4e4 2023-11-20 08:54:03,247 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/.tmp/family1/37083f412c914b149c651b6189419b73 2023-11-20 08:54:03,253 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/.tmp/family1/37083f412c914b149c651b6189419b73 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1/37083f412c914b149c651b6189419b73 2023-11-20 08:54:03,258 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1/37083f412c914b149c651b6189419b73, entries=1, sequenceid=13, filesize=4.9 K 2023-11-20 08:54:03,259 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1b2f9409842f6bf16f1fa2b0c26e8da7 in 430ms, sequenceid=13, compaction requested=true 2023-11-20 08:54:03,259 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1b2f9409842f6bf16f1fa2b0c26e8da7: 2023-11-20 08:54:03,259 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700470439728.1b2f9409842f6bf16f1fa2b0c26e8da7. 2023-11-20 08:54:03,259 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-20 08:54:03,259 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-20 08:54:03,259 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:03,259 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-20 08:54:03,259 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-20 08:54:03,261 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:03,261 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:03,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:03,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:03,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:03,261 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:03,261 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:54:03,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:03,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:03,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:03,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:03,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:03,263 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-20 08:54:03,263 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@78d88981[Count = 0] remaining members to acquire global barrier 2023-11-20 08:54:03,263 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-20 08:54:03,263 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:03,264 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:03,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:03,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:03,264 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-20 08:54:03,264 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-20 08:54:03,264 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:54:03,264 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:03,264 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:54:03,266 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:03,266 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-20 08:54:03,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:03,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:03,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:03,267 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:03,267 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-20 08:54:03,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:03,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:03,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:03,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:03,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:03,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:03,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:03,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:54:03,269 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-20 08:54:03,269 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-20 08:54:03,269 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:54:03,269 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:54:03,269 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:03,269 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:54:03,271 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:03,271 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:03,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:03,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:03,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:03,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:03,271 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:03,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:03,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:03,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:03,272 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:03,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:03,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:03,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:03,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:03,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:03,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:03,273 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:03,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:03,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:03,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:03,275 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:03,276 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:03,276 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:03,276 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:03,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:03,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:03,276 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:03,276 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:03,276 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:03,276 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-20 08:54:03,276 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:54:03,276 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:03,276 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:03,276 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:03,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:03,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:03,276 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-20 08:54:03,276 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:54:03,377 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:54:03,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:54:03,382 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:54:03,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-20 08:54:03,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:03,384 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-20 08:54:03,384 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:03,384 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-20 08:54:03,384 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-20 08:54:03,385 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:03,385 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:03,386 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:03,386 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:03,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:03,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:03,387 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:03,387 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:54:03,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:03,387 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:03,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:54:03,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:03,388 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:03,388 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-20 08:54:03,388 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:03,388 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-20 08:54:03,388 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:03,388 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-20 08:54:03,388 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-20 08:54:03,388 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:54:03,388 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700470439728.1b2f9409842f6bf16f1fa2b0c26e8da7. 2023-11-20 08:54:03,389 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700470439728.1b2f9409842f6bf16f1fa2b0c26e8da7. started... 2023-11-20 08:54:03,389 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1b2f9409842f6bf16f1fa2b0c26e8da7 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-20 08:54:03,805 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205ffecc4b7c9b84bc98c5d39b2a1ce466c to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205ffecc4b7c9b84bc98c5d39b2a1ce466c 2023-11-20 08:54:04,211 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/.tmp/family1/80dce772f3844430b11c2d8b41632c03 2023-11-20 08:54:04,217 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/.tmp/family1/80dce772f3844430b11c2d8b41632c03 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1/80dce772f3844430b11c2d8b41632c03 2023-11-20 08:54:04,222 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1/80dce772f3844430b11c2d8b41632c03, entries=1, sequenceid=17, filesize=4.9 K 2023-11-20 08:54:04,223 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1b2f9409842f6bf16f1fa2b0c26e8da7 in 834ms, sequenceid=17, compaction requested=true 2023-11-20 08:54:04,223 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1b2f9409842f6bf16f1fa2b0c26e8da7: 2023-11-20 08:54:04,223 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700470439728.1b2f9409842f6bf16f1fa2b0c26e8da7. 2023-11-20 08:54:04,223 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-20 08:54:04,223 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-20 08:54:04,223 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:04,223 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-20 08:54:04,223 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-20 08:54:04,225 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:04,225 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:04,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:04,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:04,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:04,225 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:04,225 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:54:04,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:04,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:04,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:04,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:04,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:04,226 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-20 08:54:04,227 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6190fdf7[Count = 0] remaining members to acquire global barrier 2023-11-20 08:54:04,227 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-20 08:54:04,227 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:04,228 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:04,228 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:04,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:04,228 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-20 08:54:04,228 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-20 08:54:04,228 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:54:04,228 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:04,228 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:54:04,229 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:04,229 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-20 08:54:04,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:04,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:04,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:04,229 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:04,230 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-20 08:54:04,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:04,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:04,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:04,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:04,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:04,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:04,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:04,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:54:04,232 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-20 08:54:04,232 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-20 08:54:04,232 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:54:04,232 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:54:04,232 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:04,232 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:54:04,235 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:04,235 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:04,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:04,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:04,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:04,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:04,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:04,235 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:04,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:04,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:04,236 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:04,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:04,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:04,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:04,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:04,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:04,237 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:04,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:04,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:04,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:04,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:04,243 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:04,243 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:04,243 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:04,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:04,243 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-20 08:54:04,243 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:54:04,243 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-20 08:54:04,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:04,243 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:04,243 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:04,243 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:04,243 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-20 08:54:04,243 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:04,244 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:04,244 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:04,244 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:54:04,244 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:04,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:04,244 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:04,344 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:54:04,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:54:04,349 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:54:04,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-20 08:54:04,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:04,351 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-20 08:54:04,351 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:04,351 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-20 08:54:04,351 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-20 08:54:04,351 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:04,351 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:04,353 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:04,353 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:04,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:04,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:04,353 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:04,353 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:54:04,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:04,354 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:04,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:54:04,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:04,354 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:04,355 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-20 08:54:04,355 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:04,355 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-20 08:54:04,355 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:04,355 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-20 08:54:04,355 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-20 08:54:04,355 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:54:04,355 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700470439728.1b2f9409842f6bf16f1fa2b0c26e8da7. 2023-11-20 08:54:04,355 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700470439728.1b2f9409842f6bf16f1fa2b0c26e8da7. started... 2023-11-20 08:54:04,355 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1b2f9409842f6bf16f1fa2b0c26e8da7 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-20 08:54:04,769 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122872b32a7e436c48068f59628320865f3f to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015122872b32a7e436c48068f59628320865f3f 2023-11-20 08:54:05,174 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/.tmp/family1/696e04a1a3d9481cabff745e050fb221 2023-11-20 08:54:05,180 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/.tmp/family1/696e04a1a3d9481cabff745e050fb221 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1/696e04a1a3d9481cabff745e050fb221 2023-11-20 08:54:05,185 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1/696e04a1a3d9481cabff745e050fb221, entries=1, sequenceid=21, filesize=4.9 K 2023-11-20 08:54:05,186 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1b2f9409842f6bf16f1fa2b0c26e8da7 in 831ms, sequenceid=21, compaction requested=true 2023-11-20 08:54:05,186 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1b2f9409842f6bf16f1fa2b0c26e8da7: 2023-11-20 08:54:05,186 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700470439728.1b2f9409842f6bf16f1fa2b0c26e8da7. 2023-11-20 08:54:05,186 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-20 08:54:05,186 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-20 08:54:05,186 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:05,186 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-20 08:54:05,186 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-20 08:54:05,189 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:05,189 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:05,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:05,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:05,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:05,189 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:05,189 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:54:05,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:05,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:05,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:05,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:05,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:05,191 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-20 08:54:05,191 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5683eaf[Count = 0] remaining members to acquire global barrier 2023-11-20 08:54:05,191 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-20 08:54:05,191 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:05,192 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:05,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:05,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:05,192 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-20 08:54:05,192 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-20 08:54:05,192 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:54:05,192 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:05,192 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:54:05,194 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:05,194 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-20 08:54:05,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:05,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:05,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:05,194 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:05,194 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-20 08:54:05,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:05,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:05,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:05,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:05,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:05,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:05,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:05,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:54:05,196 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-20 08:54:05,196 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-20 08:54:05,197 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:54:05,197 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:54:05,197 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:05,197 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:54:05,199 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:05,199 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:05,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:05,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:05,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:05,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:05,199 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:05,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:05,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:05,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:05,199 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:05,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:05,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:05,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:05,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:05,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:05,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:05,201 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:05,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:05,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:05,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:05,204 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:05,204 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:05,204 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:05,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:05,204 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-20 08:54:05,205 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:54:05,204 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:05,204 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:05,204 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:05,205 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:05,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:05,205 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:05,205 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-20 08:54:05,205 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:05,205 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:54:05,205 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:05,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:05,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:05,305 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:54:05,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:54:05,311 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:54:05,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-20 08:54:05,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:05,313 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-20 08:54:05,313 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:05,313 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-20 08:54:05,313 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-20 08:54:05,313 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:05,313 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:05,315 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:05,315 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:05,315 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:05,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:05,315 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:05,315 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:54:05,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:05,315 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:05,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:54:05,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:05,316 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:05,316 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-20 08:54:05,316 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:05,316 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-20 08:54:05,316 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:05,316 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-20 08:54:05,316 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-20 08:54:05,316 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:54:05,316 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700470439728.1b2f9409842f6bf16f1fa2b0c26e8da7. 2023-11-20 08:54:05,316 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700470439728.1b2f9409842f6bf16f1fa2b0c26e8da7. started... 2023-11-20 08:54:05,317 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1b2f9409842f6bf16f1fa2b0c26e8da7 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-20 08:54:05,730 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231151e82bd22a54153a82fceb132aea68b to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231151e82bd22a54153a82fceb132aea68b 2023-11-20 08:54:06,022 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-20 08:54:06,136 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/.tmp/family1/5d57161a32774543b796811d63658851 2023-11-20 08:54:06,141 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/.tmp/family1/5d57161a32774543b796811d63658851 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1/5d57161a32774543b796811d63658851 2023-11-20 08:54:06,146 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1/5d57161a32774543b796811d63658851, entries=1, sequenceid=25, filesize=4.9 K 2023-11-20 08:54:06,146 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1b2f9409842f6bf16f1fa2b0c26e8da7 in 829ms, sequenceid=25, compaction requested=true 2023-11-20 08:54:06,147 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1b2f9409842f6bf16f1fa2b0c26e8da7: 2023-11-20 08:54:06,147 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700470439728.1b2f9409842f6bf16f1fa2b0c26e8da7. 2023-11-20 08:54:06,147 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-20 08:54:06,147 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-20 08:54:06,147 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:06,147 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-20 08:54:06,147 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-20 08:54:06,149 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:06,149 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:06,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:06,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:06,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:06,149 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:06,149 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:54:06,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:06,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:06,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:06,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:06,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:06,150 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-20 08:54:06,150 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@f89d4c7[Count = 0] remaining members to acquire global barrier 2023-11-20 08:54:06,150 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-20 08:54:06,151 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:06,152 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:06,152 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:06,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:06,152 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-20 08:54:06,152 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-20 08:54:06,152 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:54:06,152 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:06,152 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:54:06,154 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-20 08:54:06,154 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:06,154 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:06,154 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-20 08:54:06,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:06,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:06,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:06,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:06,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:06,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:06,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:06,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:06,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:06,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:06,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:54:06,157 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-20 08:54:06,157 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-20 08:54:06,157 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:54:06,157 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:54:06,157 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:06,157 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:54:06,158 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:06,158 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:06,158 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:06,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:06,158 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:06,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:06,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:06,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:06,159 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:06,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:06,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:06,159 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:06,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:06,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:06,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:06,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:06,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:06,160 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:06,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:06,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:06,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:06,163 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:06,163 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:06,163 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:06,163 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:06,163 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:06,163 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:06,163 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:06,163 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:06,163 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-20 08:54:06,163 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:54:06,163 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:06,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:06,163 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:06,164 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:06,164 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-20 08:54:06,164 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:54:06,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:06,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:06,264 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:54:06,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:54:06,269 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:54:06,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-20 08:54:06,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:06,270 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-20 08:54:06,270 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:06,271 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-20 08:54:06,271 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-20 08:54:06,271 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:06,271 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:06,272 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:06,272 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:06,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:06,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:06,273 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:06,273 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:54:06,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:06,273 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:06,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:54:06,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:06,274 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:06,274 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-20 08:54:06,274 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:06,274 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-20 08:54:06,274 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:06,274 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-20 08:54:06,274 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-20 08:54:06,274 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:54:06,274 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700470439728.1b2f9409842f6bf16f1fa2b0c26e8da7. 2023-11-20 08:54:06,274 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700470439728.1b2f9409842f6bf16f1fa2b0c26e8da7. started... 2023-11-20 08:54:06,274 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1b2f9409842f6bf16f1fa2b0c26e8da7 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-20 08:54:06,690 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601013655015978254b379292b3a65b23c086 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601013655015978254b379292b3a65b23c086 2023-11-20 08:54:07,096 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/.tmp/family1/6271b1bdd8824b959d64b82318c3bb96 2023-11-20 08:54:07,101 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/.tmp/family1/6271b1bdd8824b959d64b82318c3bb96 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1/6271b1bdd8824b959d64b82318c3bb96 2023-11-20 08:54:07,106 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1/6271b1bdd8824b959d64b82318c3bb96, entries=1, sequenceid=29, filesize=4.9 K 2023-11-20 08:54:07,107 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1b2f9409842f6bf16f1fa2b0c26e8da7 in 833ms, sequenceid=29, compaction requested=true 2023-11-20 08:54:07,107 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1b2f9409842f6bf16f1fa2b0c26e8da7: 2023-11-20 08:54:07,107 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700470439728.1b2f9409842f6bf16f1fa2b0c26e8da7. 2023-11-20 08:54:07,107 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-20 08:54:07,107 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-20 08:54:07,107 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:07,107 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-20 08:54:07,107 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-20 08:54:07,110 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:07,110 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:07,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:07,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:07,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:07,110 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:07,110 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:54:07,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:07,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:07,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:07,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:07,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:07,112 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-20 08:54:07,112 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3321c036[Count = 0] remaining members to acquire global barrier 2023-11-20 08:54:07,112 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-20 08:54:07,112 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:07,113 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:07,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:07,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:07,113 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-20 08:54:07,113 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-20 08:54:07,113 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:54:07,113 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:07,113 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:54:07,115 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-20 08:54:07,115 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:07,115 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:07,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:07,115 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-20 08:54:07,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:07,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:07,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:07,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:07,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:07,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:07,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:07,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:07,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:07,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:54:07,117 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-20 08:54:07,117 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-20 08:54:07,118 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:54:07,118 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:54:07,118 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:07,118 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:54:07,123 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:07,123 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:07,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:07,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:07,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:07,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:07,124 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:07,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:07,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:07,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:07,124 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:07,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:07,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:07,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:07,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:07,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:07,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:07,126 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:07,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:07,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:07,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:07,128 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:07,128 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:07,128 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:07,128 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:07,128 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:07,128 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:07,128 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-20 08:54:07,128 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:54:07,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:07,128 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:07,128 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:07,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:07,129 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:07,129 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-20 08:54:07,129 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:07,129 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:54:07,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:07,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:07,229 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:54:07,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:54:07,234 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:54:07,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-20 08:54:07,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:07,236 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-20 08:54:07,236 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:07,236 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-20 08:54:07,236 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-20 08:54:07,236 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:07,236 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:07,237 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:07,237 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:07,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:07,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:07,238 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:07,238 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:54:07,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:07,238 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:07,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:54:07,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:07,239 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:07,239 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-20 08:54:07,239 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:07,239 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-20 08:54:07,239 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:07,239 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-20 08:54:07,239 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-20 08:54:07,239 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:54:07,239 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700470439728.1b2f9409842f6bf16f1fa2b0c26e8da7. 2023-11-20 08:54:07,239 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700470439728.1b2f9409842f6bf16f1fa2b0c26e8da7. started... 2023-11-20 08:54:07,239 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1b2f9409842f6bf16f1fa2b0c26e8da7 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-20 08:54:07,653 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601034d725083b85e4b30ad8deb094646a86b to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601034d725083b85e4b30ad8deb094646a86b 2023-11-20 08:54:08,059 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/.tmp/family1/5bda9537c18641dda545b3339eb00691 2023-11-20 08:54:08,064 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/.tmp/family1/5bda9537c18641dda545b3339eb00691 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1/5bda9537c18641dda545b3339eb00691 2023-11-20 08:54:08,069 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1/5bda9537c18641dda545b3339eb00691, entries=1, sequenceid=33, filesize=4.9 K 2023-11-20 08:54:08,070 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1b2f9409842f6bf16f1fa2b0c26e8da7 in 831ms, sequenceid=33, compaction requested=true 2023-11-20 08:54:08,070 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1b2f9409842f6bf16f1fa2b0c26e8da7: 2023-11-20 08:54:08,070 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700470439728.1b2f9409842f6bf16f1fa2b0c26e8da7. 2023-11-20 08:54:08,070 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-20 08:54:08,070 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-20 08:54:08,070 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:08,070 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-20 08:54:08,070 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-20 08:54:08,072 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:08,072 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:08,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:08,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:08,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:08,073 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:08,073 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:54:08,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:08,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:08,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:08,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:08,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:08,074 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-20 08:54:08,074 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5538fce0[Count = 0] remaining members to acquire global barrier 2023-11-20 08:54:08,074 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-20 08:54:08,074 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:08,078 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:08,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:08,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:08,078 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-20 08:54:08,078 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-20 08:54:08,078 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:54:08,078 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:08,078 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:54:08,079 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-20 08:54:08,079 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:08,079 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:08,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:08,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:08,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:08,079 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-20 08:54:08,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:08,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:08,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:08,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:08,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:08,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:08,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:08,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:54:08,081 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-20 08:54:08,081 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-20 08:54:08,082 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:54:08,082 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:54:08,082 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:08,082 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:54:08,083 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:08,083 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:08,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:08,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:08,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:08,083 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:08,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:08,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:08,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:08,084 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:08,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:08,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:08,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:08,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:08,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:08,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:08,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:08,085 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:08,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:08,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:08,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:08,088 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:08,088 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:08,088 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:08,088 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:08,088 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:08,088 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:08,088 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-20 08:54:08,089 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:54:08,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:08,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:08,088 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:08,088 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:08,089 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:08,089 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:08,089 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-20 08:54:08,089 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:54:08,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:08,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:08,189 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:54:08,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:54:08,194 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:54:08,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-20 08:54:08,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:08,196 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-20 08:54:08,196 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:08,196 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-20 08:54:08,196 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-20 08:54:08,196 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:08,196 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:08,199 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:08,199 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:08,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:08,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:08,199 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:08,199 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:54:08,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:08,200 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:08,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:54:08,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:08,200 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:08,200 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-20 08:54:08,201 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:08,201 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-20 08:54:08,201 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:08,201 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-20 08:54:08,201 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-20 08:54:08,201 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:54:08,201 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700470439728.1b2f9409842f6bf16f1fa2b0c26e8da7. 2023-11-20 08:54:08,201 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700470439728.1b2f9409842f6bf16f1fa2b0c26e8da7. started... 2023-11-20 08:54:08,201 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1b2f9409842f6bf16f1fa2b0c26e8da7 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-20 08:54:08,615 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907910daa3e1cdf4f69a9af1533415dce07 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20150907910daa3e1cdf4f69a9af1533415dce07 2023-11-20 08:54:09,020 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/.tmp/family1/c7ca9c03413d4fceb0971fb53bd14ee6 2023-11-20 08:54:09,026 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/.tmp/family1/c7ca9c03413d4fceb0971fb53bd14ee6 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1/c7ca9c03413d4fceb0971fb53bd14ee6 2023-11-20 08:54:09,030 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1/c7ca9c03413d4fceb0971fb53bd14ee6, entries=1, sequenceid=37, filesize=4.9 K 2023-11-20 08:54:09,031 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1b2f9409842f6bf16f1fa2b0c26e8da7 in 830ms, sequenceid=37, compaction requested=true 2023-11-20 08:54:09,031 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1b2f9409842f6bf16f1fa2b0c26e8da7: 2023-11-20 08:54:09,031 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700470439728.1b2f9409842f6bf16f1fa2b0c26e8da7. 2023-11-20 08:54:09,031 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-20 08:54:09,032 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-20 08:54:09,032 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:09,032 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-20 08:54:09,032 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-20 08:54:09,034 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:09,034 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:09,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:09,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:09,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:09,034 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:09,034 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:54:09,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:09,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:09,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:09,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:09,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:09,035 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-20 08:54:09,036 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@11612dae[Count = 0] remaining members to acquire global barrier 2023-11-20 08:54:09,036 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-20 08:54:09,036 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:09,037 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:09,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:09,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:09,037 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-20 08:54:09,037 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-20 08:54:09,037 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:54:09,037 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:09,037 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:54:09,039 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-20 08:54:09,039 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:09,039 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:09,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:09,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:09,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:09,039 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-20 08:54:09,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:09,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:09,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:09,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:09,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:09,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:09,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:09,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:54:09,042 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-20 08:54:09,042 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-20 08:54:09,042 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:54:09,042 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:54:09,042 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:09,042 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:54:09,044 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:09,044 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:09,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:09,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:09,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:09,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:09,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:09,044 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:09,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:09,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:09,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:09,044 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:09,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:09,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:09,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:09,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:09,046 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:09,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:09,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:09,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:09,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:09,049 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:09,049 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:09,049 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:09,049 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:09,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:09,049 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:09,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:09,050 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:09,050 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-20 08:54:09,050 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:54:09,050 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:09,050 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:09,050 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-20 08:54:09,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:09,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:09,050 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-20 08:54:09,050 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:54:09,050 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:09,050 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:09,150 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:54:09,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:54:09,156 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:54:09,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-20 08:54:09,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:09,157 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-20 08:54:09,157 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:09,157 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-20 08:54:09,157 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-20 08:54:09,158 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:09,158 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:09,159 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:09,159 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:09,159 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:09,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:09,159 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:09,159 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:54:09,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:09,160 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:09,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:54:09,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:09,160 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:09,160 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-20 08:54:09,161 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:09,161 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-20 08:54:09,161 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:09,161 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-20 08:54:09,161 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-20 08:54:09,161 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:54:09,161 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700470439728.1b2f9409842f6bf16f1fa2b0c26e8da7. 2023-11-20 08:54:09,161 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700470439728.1b2f9409842f6bf16f1fa2b0c26e8da7. started... 2023-11-20 08:54:09,161 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1b2f9409842f6bf16f1fa2b0c26e8da7 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-20 08:54:09,575 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120459ab3c333df4f5d8885ef5056b21ad3 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151120459ab3c333df4f5d8885ef5056b21ad3 2023-11-20 08:54:09,981 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/.tmp/family1/accacfe697944886817e12d6d9e1e162 2023-11-20 08:54:09,987 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/.tmp/family1/accacfe697944886817e12d6d9e1e162 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1/accacfe697944886817e12d6d9e1e162 2023-11-20 08:54:09,992 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1/accacfe697944886817e12d6d9e1e162, entries=1, sequenceid=41, filesize=4.9 K 2023-11-20 08:54:09,993 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1b2f9409842f6bf16f1fa2b0c26e8da7 in 832ms, sequenceid=41, compaction requested=true 2023-11-20 08:54:09,993 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1b2f9409842f6bf16f1fa2b0c26e8da7: 2023-11-20 08:54:09,993 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700470439728.1b2f9409842f6bf16f1fa2b0c26e8da7. 2023-11-20 08:54:09,993 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-20 08:54:09,993 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-20 08:54:09,993 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:09,994 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-20 08:54:09,994 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-20 08:54:09,996 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:09,996 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:09,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:09,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:09,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:09,996 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:09,996 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:54:09,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:09,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:09,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:09,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:09,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:09,998 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-20 08:54:09,998 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@500ffca9[Count = 0] remaining members to acquire global barrier 2023-11-20 08:54:09,998 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-20 08:54:09,998 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:10,003 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:10,003 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:10,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:10,004 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-20 08:54:10,004 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-20 08:54:10,004 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:54:10,004 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:10,004 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:54:10,005 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:10,005 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-20 08:54:10,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:10,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:10,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:10,005 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:10,006 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-20 08:54:10,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:10,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:10,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:10,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:10,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:10,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:10,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:10,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:54:10,008 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-20 08:54:10,008 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-20 08:54:10,008 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:54:10,008 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:54:10,008 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:10,008 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:54:10,010 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:10,010 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:10,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:10,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:10,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:10,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:10,010 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:10,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:10,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:10,011 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:10,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:10,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:10,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:10,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:10,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:10,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:10,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:10,012 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:10,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:10,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:10,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:10,016 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:10,016 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:10,016 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:10,016 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:10,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:10,016 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:10,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:10,016 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-20 08:54:10,016 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:54:10,016 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:10,016 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:10,016 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:10,016 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:10,016 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:10,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:10,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:10,016 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-20 08:54:10,017 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:54:10,117 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:54:10,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:54:10,119 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=36169] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMinorCompactionWithWeeklyPolicy 2023-11-20 08:54:10,121 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-20 08:54:10,121 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-20 08:54:10,122 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-20 08:54:10,122 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=26, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700471050122 2023-11-20 08:54:10,123 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-20 08:54:10,125 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 0 del files, 9 selected files, and 0 irrelevant files table 'testMinorCompactionWithWeeklyPolicy' and column 'family1' 2023-11-20 08:54:10,125 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-20 08:54:10,126 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] zookeeper.ReadOnlyZKClient(139): Connect 0x027fa91e to 127.0.0.1:64635 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-20 08:54:10,130 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4142c576, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-20 08:54:10,131 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-20 08:54:10,973 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103300fca81567a4121a83e5eec9cd3bc42 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103300fca81567a4121a83e5eec9cd3bc42 2023-11-20 08:54:10,974 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-20 08:54:10,987 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-20 08:54:10,988 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36936, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-20 08:54:10,994 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-20 08:54:10,996 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40322, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-20 08:54:11,006 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/7c6d16189f834f13aa00faf173f5ac01 first=Optional[r3] last=Optional[r6] 2023-11-20 08:54:11,007 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1700470439728.1b2f9409842f6bf16f1fa2b0c26e8da7., hostname=jenkins-hbase4.apache.org,38491,1700470412215, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/7c6d16189f834f13aa00faf173f5ac01}] 2023-11-20 08:54:11,011 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(763): Validating hfile at hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/7c6d16189f834f13aa00faf173f5ac01 for inclusion in 1b2f9409842f6bf16f1fa2b0c26e8da7/family1 2023-11-20 08:54:11,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-20 08:54:11,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(777): Region bounds: first= last= 2023-11-20 08:54:11,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HRegion(2446): Flush status journal for 1b2f9409842f6bf16f1fa2b0c26e8da7: 2023-11-20 08:54:11,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/7c6d16189f834f13aa00faf173f5ac01 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMinorCompactionWithWeeklyPolicy__kgka5j7613rrno67tg9lu38sicdmcqpmpfcoi9d549b6q7om795cqfnf7180ajtc/family1/7c6d16189f834f13aa00faf173f5ac01 2023-11-20 08:54:11,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMinorCompactionWithWeeklyPolicy__kgka5j7613rrno67tg9lu38sicdmcqpmpfcoi9d549b6q7om795cqfnf7180ajtc/family1/7c6d16189f834f13aa00faf173f5ac01 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1/7f596225ce494071ab89affa2be0e0d9_SeqId_44_ 2023-11-20 08:54:11,018 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(849): Loaded HFile hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMinorCompactionWithWeeklyPolicy__kgka5j7613rrno67tg9lu38sicdmcqpmpfcoi9d549b6q7om795cqfnf7180ajtc/family1/7c6d16189f834f13aa00faf173f5ac01 into 1b2f9409842f6bf16f1fa2b0c26e8da7/family1 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1/7f596225ce494071ab89affa2be0e0d9_SeqId_44_ - updating store file list. 2023-11-20 08:54:11,022 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(882): Loaded HFile hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1/7f596225ce494071ab89affa2be0e0d9_SeqId_44_ into 1b2f9409842f6bf16f1fa2b0c26e8da7/family1 2023-11-20 08:54:11,022 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(855): Successfully loaded hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMinorCompactionWithWeeklyPolicy__kgka5j7613rrno67tg9lu38sicdmcqpmpfcoi9d549b6q7om795cqfnf7180ajtc/family1/7c6d16189f834f13aa00faf173f5ac01 into 1b2f9409842f6bf16f1fa2b0c26e8da7/family1 (new location: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1/7f596225ce494071ab89affa2be0e0d9_SeqId_44_) 2023-11-20 08:54:11,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMinorCompactionWithWeeklyPolicy__kgka5j7613rrno67tg9lu38sicdmcqpmpfcoi9d549b6q7om795cqfnf7180ajtc/family1/7c6d16189f834f13aa00faf173f5ac01 2023-11-20 08:54:11,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-20 08:54:11,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-20 08:54:11,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(1912): 1b2f9409842f6bf16f1fa2b0c26e8da7/family1 is initiating minor compaction 2023-11-20 08:54:11,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@59ed37ef; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-20 08:54:11,027 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 1b2f9409842f6bf16f1fa2b0c26e8da7/family1 in testMinorCompactionWithWeeklyPolicy,,1700470439728.1b2f9409842f6bf16f1fa2b0c26e8da7. 2023-11-20 08:54:11,027 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1/e609eb4f0e97467792492b06e381d3d0, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1/37083f412c914b149c651b6189419b73, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1/80dce772f3844430b11c2d8b41632c03, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1/696e04a1a3d9481cabff745e050fb221, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1/5d57161a32774543b796811d63658851, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1/6271b1bdd8824b959d64b82318c3bb96, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1/5bda9537c18641dda545b3339eb00691, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1/c7ca9c03413d4fceb0971fb53bd14ee6, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1/accacfe697944886817e12d6d9e1e162, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1/7f596225ce494071ab89affa2be0e0d9_SeqId_44_] into tmpdir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/.tmp, totalSize=50.0 K 2023-11-20 08:54:11,027 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting e609eb4f0e97467792492b06e381d3d0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-20 08:54:11,027 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting 37083f412c914b149c651b6189419b73, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-20 08:54:11,027 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting 80dce772f3844430b11c2d8b41632c03, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-20 08:54:11,028 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting 696e04a1a3d9481cabff745e050fb221, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-20 08:54:11,028 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting 5d57161a32774543b796811d63658851, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-20 08:54:11,028 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting 6271b1bdd8824b959d64b82318c3bb96, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-20 08:54:11,028 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting 5bda9537c18641dda545b3339eb00691, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-20 08:54:11,028 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting c7ca9c03413d4fceb0971fb53bd14ee6, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-20 08:54:11,028 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting accacfe697944886817e12d6d9e1e162, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-20 08:54:11,028 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting 7f596225ce494071ab89affa2be0e0d9_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-20 08:54:11,029 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-20 08:54:11,030 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:54:11,032 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015122872b32a7e436c48068f59628320865f3f to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015122872b32a7e436c48068f59628320865f3f 2023-11-20 08:54:11,033 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231151e82bd22a54153a82fceb132aea68b to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231151e82bd22a54153a82fceb132aea68b 2023-11-20 08:54:11,034 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601013655015978254b379292b3a65b23c086 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601013655015978254b379292b3a65b23c086 2023-11-20 08:54:11,036 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601034d725083b85e4b30ad8deb094646a86b to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601034d725083b85e4b30ad8deb094646a86b 2023-11-20 08:54:11,036 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-11-20 08:54:11,036 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-20 08:54:11,036 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-20 08:54:11,036 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-20 08:54:11,036 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-20 08:54:11,037 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-20 08:54:11,037 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-20 08:54:11,037 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-20 08:54:11,040 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-20 08:54:11,040 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-20 08:54:11,065 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] throttle.PressureAwareThroughputController(145): 1b2f9409842f6bf16f1fa2b0c26e8da7#family1#compaction#34 average throughput is 0.15 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-20 08:54:11,086 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205ea1b6c7930f54358a4d6309066280564 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205ea1b6c7930f54358a4d6309066280564 2023-11-20 08:54:11,087 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-20 08:54:11,112 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/fc5165d3f1e14bb891d17fd7fc396e17 first=Optional[r1] last=Optional[r2] 2023-11-20 08:54:11,113 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1700470439728.1b2f9409842f6bf16f1fa2b0c26e8da7., hostname=jenkins-hbase4.apache.org,38491,1700470412215, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/fc5165d3f1e14bb891d17fd7fc396e17}] 2023-11-20 08:54:11,116 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(763): Validating hfile at hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/fc5165d3f1e14bb891d17fd7fc396e17 for inclusion in 1b2f9409842f6bf16f1fa2b0c26e8da7/family1 2023-11-20 08:54:11,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-11-20 08:54:11,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(777): Region bounds: first= last= 2023-11-20 08:54:11,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HRegion(2446): Flush status journal for 1b2f9409842f6bf16f1fa2b0c26e8da7: 2023-11-20 08:54:11,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/fc5165d3f1e14bb891d17fd7fc396e17 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMinorCompactionWithWeeklyPolicy__e9hp33q48kpsij3ks7gtsc8abbp52236tvqm2722i64cd46hs8a10k5u79j93735/family1/fc5165d3f1e14bb891d17fd7fc396e17 2023-11-20 08:54:11,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMinorCompactionWithWeeklyPolicy__e9hp33q48kpsij3ks7gtsc8abbp52236tvqm2722i64cd46hs8a10k5u79j93735/family1/fc5165d3f1e14bb891d17fd7fc396e17 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1/df3955952d7048f8873b51cef075592f_SeqId_46_ 2023-11-20 08:54:11,123 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(849): Loaded HFile hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMinorCompactionWithWeeklyPolicy__e9hp33q48kpsij3ks7gtsc8abbp52236tvqm2722i64cd46hs8a10k5u79j93735/family1/fc5165d3f1e14bb891d17fd7fc396e17 into 1b2f9409842f6bf16f1fa2b0c26e8da7/family1 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1/df3955952d7048f8873b51cef075592f_SeqId_46_ - updating store file list. 2023-11-20 08:54:11,126 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(882): Loaded HFile hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1/df3955952d7048f8873b51cef075592f_SeqId_46_ into 1b2f9409842f6bf16f1fa2b0c26e8da7/family1 2023-11-20 08:54:11,126 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(855): Successfully loaded hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMinorCompactionWithWeeklyPolicy__e9hp33q48kpsij3ks7gtsc8abbp52236tvqm2722i64cd46hs8a10k5u79j93735/family1/fc5165d3f1e14bb891d17fd7fc396e17 into 1b2f9409842f6bf16f1fa2b0c26e8da7/family1 (new location: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1/df3955952d7048f8873b51cef075592f_SeqId_46_) 2023-11-20 08:54:11,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMinorCompactionWithWeeklyPolicy__e9hp33q48kpsij3ks7gtsc8abbp52236tvqm2722i64cd46hs8a10k5u79j93735/family1/fc5165d3f1e14bb891d17fd7fc396e17 2023-11-20 08:54:11,129 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-20 08:54:11,130 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:54:11,131 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120160812b1e4e294680b55b2f904f9ce4e4 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120160812b1e4e294680b55b2f904f9ce4e4 2023-11-20 08:54:11,132 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205ffecc4b7c9b84bc98c5d39b2a1ce466c to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205ffecc4b7c9b84bc98c5d39b2a1ce466c 2023-11-20 08:54:11,132 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 2 expired mob files are deleted 2023-11-20 08:54:11,132 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-20 08:54:11,133 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-20 08:54:11,133 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-20 08:54:11,133 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-20 08:54:11,134 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=26, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-20 08:54:11,135 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.0140 sec 2023-11-20 08:54:11,247 INFO [Listener at localhost/43513] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=265 (was 267), OpenFileDescriptor=665 (was 652) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=204 (was 237), ProcessCount=170 (was 170), AvailableMemoryMB=14855 (was 14997) 2023-11-20 08:54:11,258 INFO [Listener at localhost/43513] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=265, OpenFileDescriptor=665, MaxFileDescriptor=60000, SystemLoadAverage=204, ProcessCount=170, AvailableMemoryMB=14854 2023-11-20 08:54:11,260 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-20 08:54:11,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles 2023-11-20 08:54:11,262 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_PRE_OPERATION 2023-11-20 08:54:11,262 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testScannerOnBulkLoadRefHFiles" procId is: 27 2023-11-20 08:54:11,263 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-20 08:54:11,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-20 08:54:11,265 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/default/testScannerOnBulkLoadRefHFiles/32148f74faef43fe3181334f58210602 2023-11-20 08:54:11,265 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/default/testScannerOnBulkLoadRefHFiles/53dd3cf22f6da76994961de186109db6 2023-11-20 08:54:11,265 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/default/testScannerOnBulkLoadRefHFiles/612548ffeca5aef6aedcb4899d4e1a66 2023-11-20 08:54:11,266 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/default/testScannerOnBulkLoadRefHFiles/32148f74faef43fe3181334f58210602 empty. 2023-11-20 08:54:11,266 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/default/testScannerOnBulkLoadRefHFiles/53dd3cf22f6da76994961de186109db6 empty. 2023-11-20 08:54:11,266 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/default/testScannerOnBulkLoadRefHFiles/612548ffeca5aef6aedcb4899d4e1a66 empty. 2023-11-20 08:54:11,266 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/default/testScannerOnBulkLoadRefHFiles/32148f74faef43fe3181334f58210602 2023-11-20 08:54:11,266 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/default/testScannerOnBulkLoadRefHFiles/612548ffeca5aef6aedcb4899d4e1a66 2023-11-20 08:54:11,266 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/default/testScannerOnBulkLoadRefHFiles/53dd3cf22f6da76994961de186109db6 2023-11-20 08:54:11,266 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testScannerOnBulkLoadRefHFiles regions 2023-11-20 08:54:11,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-20 08:54:11,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-20 08:54:11,676 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/default/testScannerOnBulkLoadRefHFiles/.tabledesc/.tableinfo.0000000001 2023-11-20 08:54:11,677 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(7675): creating {ENCODED => 612548ffeca5aef6aedcb4899d4e1a66, NAME => 'testScannerOnBulkLoadRefHFiles,2,1700470451259.612548ffeca5aef6aedcb4899d4e1a66.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp 2023-11-20 08:54:11,678 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(7675): creating {ENCODED => 53dd3cf22f6da76994961de186109db6, NAME => 'testScannerOnBulkLoadRefHFiles,1,1700470451259.53dd3cf22f6da76994961de186109db6.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp 2023-11-20 08:54:11,678 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(7675): creating {ENCODED => 32148f74faef43fe3181334f58210602, NAME => 'testScannerOnBulkLoadRefHFiles,,1700470451259.32148f74faef43fe3181334f58210602.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp 2023-11-20 08:54:11,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-20 08:54:11,881 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/.tmp/family1/18881d80b9244043b95674389d3b4df6 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1/18881d80b9244043b95674389d3b4df6 2023-11-20 08:54:11,886 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 1b2f9409842f6bf16f1fa2b0c26e8da7/family1 of 1b2f9409842f6bf16f1fa2b0c26e8da7 into 18881d80b9244043b95674389d3b4df6(size=6.6 K), total size for store is 176.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-20 08:54:11,886 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 1b2f9409842f6bf16f1fa2b0c26e8da7: 2023-11-20 08:54:11,886 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1700470439728.1b2f9409842f6bf16f1fa2b0c26e8da7., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1700470451027; duration=0sec 2023-11-20 08:54:11,886 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-20 08:54:11,911 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1/e609eb4f0e97467792492b06e381d3d0, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1/37083f412c914b149c651b6189419b73, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1/80dce772f3844430b11c2d8b41632c03, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1/696e04a1a3d9481cabff745e050fb221, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1/5d57161a32774543b796811d63658851, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1/6271b1bdd8824b959d64b82318c3bb96, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1/5bda9537c18641dda545b3339eb00691, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1/c7ca9c03413d4fceb0971fb53bd14ee6, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1/accacfe697944886817e12d6d9e1e162, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1/7f596225ce494071ab89affa2be0e0d9_SeqId_44_] to archive 2023-11-20 08:54:11,912 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:54:11,914 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1/e609eb4f0e97467792492b06e381d3d0 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1/e609eb4f0e97467792492b06e381d3d0 2023-11-20 08:54:11,915 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1/37083f412c914b149c651b6189419b73 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1/37083f412c914b149c651b6189419b73 2023-11-20 08:54:11,916 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1/80dce772f3844430b11c2d8b41632c03 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1/80dce772f3844430b11c2d8b41632c03 2023-11-20 08:54:11,917 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1/696e04a1a3d9481cabff745e050fb221 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1/696e04a1a3d9481cabff745e050fb221 2023-11-20 08:54:11,918 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1/5d57161a32774543b796811d63658851 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1/5d57161a32774543b796811d63658851 2023-11-20 08:54:11,919 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1/6271b1bdd8824b959d64b82318c3bb96 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1/6271b1bdd8824b959d64b82318c3bb96 2023-11-20 08:54:11,920 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1/5bda9537c18641dda545b3339eb00691 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1/5bda9537c18641dda545b3339eb00691 2023-11-20 08:54:11,922 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1/c7ca9c03413d4fceb0971fb53bd14ee6 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1/c7ca9c03413d4fceb0971fb53bd14ee6 2023-11-20 08:54:11,923 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1/accacfe697944886817e12d6d9e1e162 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1/accacfe697944886817e12d6d9e1e162 2023-11-20 08:54:11,924 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1/7f596225ce494071ab89affa2be0e0d9_SeqId_44_ to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/family1/7f596225ce494071ab89affa2be0e0d9_SeqId_44_ 2023-11-20 08:54:12,089 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1700470451259.612548ffeca5aef6aedcb4899d4e1a66.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-20 08:54:12,089 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1700470451259.53dd3cf22f6da76994961de186109db6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-20 08:54:12,089 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1604): Closing 612548ffeca5aef6aedcb4899d4e1a66, disabling compactions & flushes 2023-11-20 08:54:12,089 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1604): Closing 53dd3cf22f6da76994961de186109db6, disabling compactions & flushes 2023-11-20 08:54:12,089 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1700470451259.612548ffeca5aef6aedcb4899d4e1a66. 2023-11-20 08:54:12,089 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1700470451259.53dd3cf22f6da76994961de186109db6. 2023-11-20 08:54:12,089 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1700470451259.612548ffeca5aef6aedcb4899d4e1a66. 2023-11-20 08:54:12,089 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1700470451259.53dd3cf22f6da76994961de186109db6. 2023-11-20 08:54:12,089 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1700470451259.612548ffeca5aef6aedcb4899d4e1a66. after waiting 0 ms 2023-11-20 08:54:12,089 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1700470451259.53dd3cf22f6da76994961de186109db6. after waiting 0 ms 2023-11-20 08:54:12,089 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1700470451259.53dd3cf22f6da76994961de186109db6. 2023-11-20 08:54:12,089 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1700470451259.612548ffeca5aef6aedcb4899d4e1a66. 2023-11-20 08:54:12,089 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1700470451259.53dd3cf22f6da76994961de186109db6. 2023-11-20 08:54:12,089 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1700470451259.612548ffeca5aef6aedcb4899d4e1a66. 2023-11-20 08:54:12,089 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1558): Region close journal for 53dd3cf22f6da76994961de186109db6: 2023-11-20 08:54:12,089 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1558): Region close journal for 612548ffeca5aef6aedcb4899d4e1a66: 2023-11-20 08:54:12,090 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1700470451259.32148f74faef43fe3181334f58210602.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-20 08:54:12,090 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1604): Closing 32148f74faef43fe3181334f58210602, disabling compactions & flushes 2023-11-20 08:54:12,090 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1700470451259.32148f74faef43fe3181334f58210602. 2023-11-20 08:54:12,090 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1700470451259.32148f74faef43fe3181334f58210602. 2023-11-20 08:54:12,090 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1700470451259.32148f74faef43fe3181334f58210602. after waiting 0 ms 2023-11-20 08:54:12,090 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1700470451259.32148f74faef43fe3181334f58210602. 2023-11-20 08:54:12,090 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1700470451259.32148f74faef43fe3181334f58210602. 2023-11-20 08:54:12,090 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1558): Region close journal for 32148f74faef43fe3181334f58210602: 2023-11-20 08:54:12,093 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ADD_TO_META 2023-11-20 08:54:12,094 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,1,1700470451259.53dd3cf22f6da76994961de186109db6.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1700470452093"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700470452093"}]},"ts":"1700470452093"} 2023-11-20 08:54:12,094 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,2,1700470451259.612548ffeca5aef6aedcb4899d4e1a66.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1700470452093"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700470452093"}]},"ts":"1700470452093"} 2023-11-20 08:54:12,094 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,,1700470451259.32148f74faef43fe3181334f58210602.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1700470452093"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700470452093"}]},"ts":"1700470452093"} 2023-11-20 08:54:12,097 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-20 08:54:12,097 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-20 08:54:12,098 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700470452098"}]},"ts":"1700470452098"} 2023-11-20 08:54:12,099 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLING in hbase:meta 2023-11-20 08:54:12,103 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=32148f74faef43fe3181334f58210602, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=53dd3cf22f6da76994961de186109db6, ASSIGN}, {pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=612548ffeca5aef6aedcb4899d4e1a66, ASSIGN}] 2023-11-20 08:54:12,105 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=53dd3cf22f6da76994961de186109db6, ASSIGN 2023-11-20 08:54:12,105 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=612548ffeca5aef6aedcb4899d4e1a66, ASSIGN 2023-11-20 08:54:12,105 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=32148f74faef43fe3181334f58210602, ASSIGN 2023-11-20 08:54:12,105 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=612548ffeca5aef6aedcb4899d4e1a66, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38491,1700470412215; forceNewPlan=false, retain=false 2023-11-20 08:54:12,105 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=53dd3cf22f6da76994961de186109db6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38491,1700470412215; forceNewPlan=false, retain=false 2023-11-20 08:54:12,105 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=32148f74faef43fe3181334f58210602, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38491,1700470412215; forceNewPlan=false, retain=false 2023-11-20 08:54:12,257 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=53dd3cf22f6da76994961de186109db6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:12,257 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=32148f74faef43fe3181334f58210602, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:12,257 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=612548ffeca5aef6aedcb4899d4e1a66, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:12,257 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,1,1700470451259.53dd3cf22f6da76994961de186109db6.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1700470452257"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700470452257"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700470452257"}]},"ts":"1700470452257"} 2023-11-20 08:54:12,257 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,,1700470451259.32148f74faef43fe3181334f58210602.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1700470452257"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700470452257"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700470452257"}]},"ts":"1700470452257"} 2023-11-20 08:54:12,257 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,2,1700470451259.612548ffeca5aef6aedcb4899d4e1a66.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1700470452257"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700470452257"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700470452257"}]},"ts":"1700470452257"} 2023-11-20 08:54:12,259 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure 53dd3cf22f6da76994961de186109db6, server=jenkins-hbase4.apache.org,38491,1700470412215}] 2023-11-20 08:54:12,259 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=32, ppid=28, state=RUNNABLE; OpenRegionProcedure 32148f74faef43fe3181334f58210602, server=jenkins-hbase4.apache.org,38491,1700470412215}] 2023-11-20 08:54:12,260 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=33, ppid=30, state=RUNNABLE; OpenRegionProcedure 612548ffeca5aef6aedcb4899d4e1a66, server=jenkins-hbase4.apache.org,38491,1700470412215}] 2023-11-20 08:54:12,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-20 08:54:12,410 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:12,413 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,1,1700470451259.53dd3cf22f6da76994961de186109db6. 2023-11-20 08:54:12,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 53dd3cf22f6da76994961de186109db6, NAME => 'testScannerOnBulkLoadRefHFiles,1,1700470451259.53dd3cf22f6da76994961de186109db6.', STARTKEY => '1', ENDKEY => '2'} 2023-11-20 08:54:12,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 53dd3cf22f6da76994961de186109db6 2023-11-20 08:54:12,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1700470451259.53dd3cf22f6da76994961de186109db6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-20 08:54:12,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 53dd3cf22f6da76994961de186109db6 2023-11-20 08:54:12,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 53dd3cf22f6da76994961de186109db6 2023-11-20 08:54:12,415 INFO [StoreOpener-53dd3cf22f6da76994961de186109db6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 53dd3cf22f6da76994961de186109db6 2023-11-20 08:54:12,417 DEBUG [StoreOpener-53dd3cf22f6da76994961de186109db6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testScannerOnBulkLoadRefHFiles/53dd3cf22f6da76994961de186109db6/family1 2023-11-20 08:54:12,417 DEBUG [StoreOpener-53dd3cf22f6da76994961de186109db6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testScannerOnBulkLoadRefHFiles/53dd3cf22f6da76994961de186109db6/family1 2023-11-20 08:54:12,417 INFO [StoreOpener-53dd3cf22f6da76994961de186109db6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 53dd3cf22f6da76994961de186109db6 columnFamilyName family1 2023-11-20 08:54:12,419 INFO [StoreOpener-53dd3cf22f6da76994961de186109db6-1] regionserver.HStore(310): Store=53dd3cf22f6da76994961de186109db6/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-20 08:54:12,419 INFO [StoreOpener-53dd3cf22f6da76994961de186109db6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 53dd3cf22f6da76994961de186109db6 2023-11-20 08:54:12,420 DEBUG [StoreOpener-53dd3cf22f6da76994961de186109db6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testScannerOnBulkLoadRefHFiles/53dd3cf22f6da76994961de186109db6/family2 2023-11-20 08:54:12,420 DEBUG [StoreOpener-53dd3cf22f6da76994961de186109db6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testScannerOnBulkLoadRefHFiles/53dd3cf22f6da76994961de186109db6/family2 2023-11-20 08:54:12,421 INFO [StoreOpener-53dd3cf22f6da76994961de186109db6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 53dd3cf22f6da76994961de186109db6 columnFamilyName family2 2023-11-20 08:54:12,422 INFO [StoreOpener-53dd3cf22f6da76994961de186109db6-1] regionserver.HStore(310): Store=53dd3cf22f6da76994961de186109db6/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-20 08:54:12,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testScannerOnBulkLoadRefHFiles/53dd3cf22f6da76994961de186109db6 2023-11-20 08:54:12,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testScannerOnBulkLoadRefHFiles/53dd3cf22f6da76994961de186109db6 2023-11-20 08:54:12,425 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-20 08:54:12,426 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 53dd3cf22f6da76994961de186109db6 2023-11-20 08:54:12,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testScannerOnBulkLoadRefHFiles/53dd3cf22f6da76994961de186109db6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-20 08:54:12,428 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 53dd3cf22f6da76994961de186109db6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73433980, jitterRate=0.09425157308578491}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-20 08:54:12,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 53dd3cf22f6da76994961de186109db6: 2023-11-20 08:54:12,429 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,1,1700470451259.53dd3cf22f6da76994961de186109db6., pid=31, masterSystemTime=1700470452410 2023-11-20 08:54:12,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,1,1700470451259.53dd3cf22f6da76994961de186109db6. 2023-11-20 08:54:12,430 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,1,1700470451259.53dd3cf22f6da76994961de186109db6. 2023-11-20 08:54:12,431 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,,1700470451259.32148f74faef43fe3181334f58210602. 2023-11-20 08:54:12,431 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 32148f74faef43fe3181334f58210602, NAME => 'testScannerOnBulkLoadRefHFiles,,1700470451259.32148f74faef43fe3181334f58210602.', STARTKEY => '', ENDKEY => '1'} 2023-11-20 08:54:12,431 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 32148f74faef43fe3181334f58210602 2023-11-20 08:54:12,431 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1700470451259.32148f74faef43fe3181334f58210602.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-20 08:54:12,431 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=53dd3cf22f6da76994961de186109db6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:12,431 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 32148f74faef43fe3181334f58210602 2023-11-20 08:54:12,431 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 32148f74faef43fe3181334f58210602 2023-11-20 08:54:12,431 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,1,1700470451259.53dd3cf22f6da76994961de186109db6.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1700470452431"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700470452431"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700470452431"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700470452431"}]},"ts":"1700470452431"} 2023-11-20 08:54:12,432 INFO [StoreOpener-32148f74faef43fe3181334f58210602-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 32148f74faef43fe3181334f58210602 2023-11-20 08:54:12,434 DEBUG [StoreOpener-32148f74faef43fe3181334f58210602-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testScannerOnBulkLoadRefHFiles/32148f74faef43fe3181334f58210602/family1 2023-11-20 08:54:12,434 DEBUG [StoreOpener-32148f74faef43fe3181334f58210602-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testScannerOnBulkLoadRefHFiles/32148f74faef43fe3181334f58210602/family1 2023-11-20 08:54:12,434 INFO [StoreOpener-32148f74faef43fe3181334f58210602-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 32148f74faef43fe3181334f58210602 columnFamilyName family1 2023-11-20 08:54:12,435 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=29 2023-11-20 08:54:12,435 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure 53dd3cf22f6da76994961de186109db6, server=jenkins-hbase4.apache.org,38491,1700470412215 in 174 msec 2023-11-20 08:54:12,435 INFO [StoreOpener-32148f74faef43fe3181334f58210602-1] regionserver.HStore(310): Store=32148f74faef43fe3181334f58210602/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-20 08:54:12,435 INFO [StoreOpener-32148f74faef43fe3181334f58210602-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 32148f74faef43fe3181334f58210602 2023-11-20 08:54:12,436 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=53dd3cf22f6da76994961de186109db6, ASSIGN in 332 msec 2023-11-20 08:54:12,437 DEBUG [StoreOpener-32148f74faef43fe3181334f58210602-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testScannerOnBulkLoadRefHFiles/32148f74faef43fe3181334f58210602/family2 2023-11-20 08:54:12,437 DEBUG [StoreOpener-32148f74faef43fe3181334f58210602-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testScannerOnBulkLoadRefHFiles/32148f74faef43fe3181334f58210602/family2 2023-11-20 08:54:12,438 INFO [StoreOpener-32148f74faef43fe3181334f58210602-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 32148f74faef43fe3181334f58210602 columnFamilyName family2 2023-11-20 08:54:12,439 INFO [StoreOpener-32148f74faef43fe3181334f58210602-1] regionserver.HStore(310): Store=32148f74faef43fe3181334f58210602/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-20 08:54:12,440 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testScannerOnBulkLoadRefHFiles/32148f74faef43fe3181334f58210602 2023-11-20 08:54:12,440 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testScannerOnBulkLoadRefHFiles/32148f74faef43fe3181334f58210602 2023-11-20 08:54:12,441 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-20 08:54:12,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 32148f74faef43fe3181334f58210602 2023-11-20 08:54:12,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testScannerOnBulkLoadRefHFiles/32148f74faef43fe3181334f58210602/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-20 08:54:12,444 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 32148f74faef43fe3181334f58210602; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69594748, jitterRate=0.03704255819320679}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-20 08:54:12,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 32148f74faef43fe3181334f58210602: 2023-11-20 08:54:12,445 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,,1700470451259.32148f74faef43fe3181334f58210602., pid=32, masterSystemTime=1700470452410 2023-11-20 08:54:12,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,,1700470451259.32148f74faef43fe3181334f58210602. 2023-11-20 08:54:12,446 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,,1700470451259.32148f74faef43fe3181334f58210602. 2023-11-20 08:54:12,446 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,2,1700470451259.612548ffeca5aef6aedcb4899d4e1a66. 2023-11-20 08:54:12,447 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 612548ffeca5aef6aedcb4899d4e1a66, NAME => 'testScannerOnBulkLoadRefHFiles,2,1700470451259.612548ffeca5aef6aedcb4899d4e1a66.', STARTKEY => '2', ENDKEY => ''} 2023-11-20 08:54:12,447 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 612548ffeca5aef6aedcb4899d4e1a66 2023-11-20 08:54:12,447 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=32148f74faef43fe3181334f58210602, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:12,447 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1700470451259.612548ffeca5aef6aedcb4899d4e1a66.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-20 08:54:12,447 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 612548ffeca5aef6aedcb4899d4e1a66 2023-11-20 08:54:12,447 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,,1700470451259.32148f74faef43fe3181334f58210602.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1700470452447"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700470452447"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700470452447"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700470452447"}]},"ts":"1700470452447"} 2023-11-20 08:54:12,447 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 612548ffeca5aef6aedcb4899d4e1a66 2023-11-20 08:54:12,448 INFO [StoreOpener-612548ffeca5aef6aedcb4899d4e1a66-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 612548ffeca5aef6aedcb4899d4e1a66 2023-11-20 08:54:12,449 DEBUG [StoreOpener-612548ffeca5aef6aedcb4899d4e1a66-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testScannerOnBulkLoadRefHFiles/612548ffeca5aef6aedcb4899d4e1a66/family1 2023-11-20 08:54:12,449 DEBUG [StoreOpener-612548ffeca5aef6aedcb4899d4e1a66-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testScannerOnBulkLoadRefHFiles/612548ffeca5aef6aedcb4899d4e1a66/family1 2023-11-20 08:54:12,450 INFO [StoreOpener-612548ffeca5aef6aedcb4899d4e1a66-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 612548ffeca5aef6aedcb4899d4e1a66 columnFamilyName family1 2023-11-20 08:54:12,450 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=32, resume processing ppid=28 2023-11-20 08:54:12,450 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=32, ppid=28, state=SUCCESS; OpenRegionProcedure 32148f74faef43fe3181334f58210602, server=jenkins-hbase4.apache.org,38491,1700470412215 in 189 msec 2023-11-20 08:54:12,451 INFO [StoreOpener-612548ffeca5aef6aedcb4899d4e1a66-1] regionserver.HStore(310): Store=612548ffeca5aef6aedcb4899d4e1a66/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-20 08:54:12,451 INFO [StoreOpener-612548ffeca5aef6aedcb4899d4e1a66-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 612548ffeca5aef6aedcb4899d4e1a66 2023-11-20 08:54:12,452 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=32148f74faef43fe3181334f58210602, ASSIGN in 347 msec 2023-11-20 08:54:12,452 DEBUG [StoreOpener-612548ffeca5aef6aedcb4899d4e1a66-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testScannerOnBulkLoadRefHFiles/612548ffeca5aef6aedcb4899d4e1a66/family2 2023-11-20 08:54:12,452 DEBUG [StoreOpener-612548ffeca5aef6aedcb4899d4e1a66-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testScannerOnBulkLoadRefHFiles/612548ffeca5aef6aedcb4899d4e1a66/family2 2023-11-20 08:54:12,453 INFO [StoreOpener-612548ffeca5aef6aedcb4899d4e1a66-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 612548ffeca5aef6aedcb4899d4e1a66 columnFamilyName family2 2023-11-20 08:54:12,454 INFO [StoreOpener-612548ffeca5aef6aedcb4899d4e1a66-1] regionserver.HStore(310): Store=612548ffeca5aef6aedcb4899d4e1a66/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-20 08:54:12,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testScannerOnBulkLoadRefHFiles/612548ffeca5aef6aedcb4899d4e1a66 2023-11-20 08:54:12,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testScannerOnBulkLoadRefHFiles/612548ffeca5aef6aedcb4899d4e1a66 2023-11-20 08:54:12,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-20 08:54:12,458 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 612548ffeca5aef6aedcb4899d4e1a66 2023-11-20 08:54:12,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testScannerOnBulkLoadRefHFiles/612548ffeca5aef6aedcb4899d4e1a66/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-20 08:54:12,460 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 612548ffeca5aef6aedcb4899d4e1a66; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59091694, jitterRate=-0.11946514248847961}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-20 08:54:12,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 612548ffeca5aef6aedcb4899d4e1a66: 2023-11-20 08:54:12,460 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,2,1700470451259.612548ffeca5aef6aedcb4899d4e1a66., pid=33, masterSystemTime=1700470452410 2023-11-20 08:54:12,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,2,1700470451259.612548ffeca5aef6aedcb4899d4e1a66. 2023-11-20 08:54:12,461 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,2,1700470451259.612548ffeca5aef6aedcb4899d4e1a66. 2023-11-20 08:54:12,462 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=612548ffeca5aef6aedcb4899d4e1a66, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:12,462 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,2,1700470451259.612548ffeca5aef6aedcb4899d4e1a66.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1700470452462"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700470452462"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700470452462"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700470452462"}]},"ts":"1700470452462"} 2023-11-20 08:54:12,465 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=33, resume processing ppid=30 2023-11-20 08:54:12,465 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=33, ppid=30, state=SUCCESS; OpenRegionProcedure 612548ffeca5aef6aedcb4899d4e1a66, server=jenkins-hbase4.apache.org,38491,1700470412215 in 203 msec 2023-11-20 08:54:12,466 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=27 2023-11-20 08:54:12,466 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=612548ffeca5aef6aedcb4899d4e1a66, ASSIGN in 362 msec 2023-11-20 08:54:12,467 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-20 08:54:12,467 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700470452467"}]},"ts":"1700470452467"} 2023-11-20 08:54:12,468 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLED in hbase:meta 2023-11-20 08:54:12,471 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_POST_OPERATION 2023-11-20 08:54:12,473 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles in 1.2110 sec 2023-11-20 08:54:13,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-20 08:54:13,369 INFO [Listener at localhost/43513] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testScannerOnBulkLoadRefHFiles, procId: 27 completed 2023-11-20 08:54:13,376 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:54:13,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-11-20 08:54:13,378 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-11-20 08:54:13,378 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:13,378 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-11-20 08:54:13,378 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-11-20 08:54:13,378 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-20 08:54:13,378 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-20 08:54:13,379 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:13,379 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:13,380 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:13,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:13,380 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:13,380 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:54:13,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-20 08:54:13,380 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-20 08:54:13,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:54:13,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-20 08:54:13,381 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-11-20 08:54:13,381 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-11-20 08:54:13,381 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-11-20 08:54:13,381 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:13,381 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-11-20 08:54:13,381 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1700470451259.53dd3cf22f6da76994961de186109db6. 2023-11-20 08:54:13,381 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1700470451259.53dd3cf22f6da76994961de186109db6. started... 2023-11-20 08:54:13,381 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1700470451259.32148f74faef43fe3181334f58210602. 2023-11-20 08:54:13,382 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1700470451259.612548ffeca5aef6aedcb4899d4e1a66. 2023-11-20 08:54:13,382 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 53dd3cf22f6da76994961de186109db6: 2023-11-20 08:54:13,381 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-20 08:54:13,382 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:54:13,382 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1700470451259.53dd3cf22f6da76994961de186109db6. 2023-11-20 08:54:13,382 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1700470451259.612548ffeca5aef6aedcb4899d4e1a66. started... 2023-11-20 08:54:13,382 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-20 08:54:13,382 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1700470451259.32148f74faef43fe3181334f58210602. started... 2023-11-20 08:54:13,383 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 612548ffeca5aef6aedcb4899d4e1a66 2/2 column families, dataSize=48 B heapSize=632 B 2023-11-20 08:54:13,383 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 32148f74faef43fe3181334f58210602: 2023-11-20 08:54:13,383 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1700470451259.32148f74faef43fe3181334f58210602. 2023-11-20 08:54:13,383 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-20 08:54:13,796 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231120ccee5b8e83dc456fbd334cec3701afc8 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231120ccee5b8e83dc456fbd334cec3701afc8 2023-11-20 08:54:14,202 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=48, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testScannerOnBulkLoadRefHFiles/612548ffeca5aef6aedcb4899d4e1a66/.tmp/family1/e58778c258544d40a41b8cd55e269e2e 2023-11-20 08:54:14,208 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testScannerOnBulkLoadRefHFiles/612548ffeca5aef6aedcb4899d4e1a66/.tmp/family1/e58778c258544d40a41b8cd55e269e2e as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testScannerOnBulkLoadRefHFiles/612548ffeca5aef6aedcb4899d4e1a66/family1/e58778c258544d40a41b8cd55e269e2e 2023-11-20 08:54:14,215 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testScannerOnBulkLoadRefHFiles/612548ffeca5aef6aedcb4899d4e1a66/family1/e58778c258544d40a41b8cd55e269e2e, entries=1, sequenceid=5, filesize=4.9 K 2023-11-20 08:54:14,216 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~48 B/48, heapSize ~360 B/360, currentSize=0 B/0 for 612548ffeca5aef6aedcb4899d4e1a66 in 833ms, sequenceid=5, compaction requested=false 2023-11-20 08:54:14,216 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testScannerOnBulkLoadRefHFiles' 2023-11-20 08:54:14,217 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 612548ffeca5aef6aedcb4899d4e1a66: 2023-11-20 08:54:14,217 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1700470451259.612548ffeca5aef6aedcb4899d4e1a66. 2023-11-20 08:54:14,217 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-20 08:54:14,217 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-20 08:54:14,217 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:14,217 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-11-20 08:54:14,217 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-11-20 08:54:14,219 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:14,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:14,219 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-20 08:54:14,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:14,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:14,220 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-20 08:54:14,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:14,220 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:54:14,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:14,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-20 08:54:14,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:14,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:14,222 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-11-20 08:54:14,222 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d12b6ee[Count = 0] remaining members to acquire global barrier 2023-11-20 08:54:14,222 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-11-20 08:54:14,222 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-20 08:54:14,223 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-20 08:54:14,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-20 08:54:14,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-20 08:54:14,224 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-11-20 08:54:14,224 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:14,224 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:54:14,224 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-11-20 08:54:14,224 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:54:14,226 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-11-20 08:54:14,226 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:14,226 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:14,226 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-11-20 08:54:14,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:14,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:14,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:14,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:14,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:14,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-20 08:54:14,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:14,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:14,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-20 08:54:14,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:14,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:54:14,229 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-11-20 08:54:14,229 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-11-20 08:54:14,229 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:54:14,229 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:54:14,229 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-11-20 08:54:14,229 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:54:14,232 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-20 08:54:14,232 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-20 08:54:14,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-20 08:54:14,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:14,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:14,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-20 08:54:14,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-20 08:54:14,232 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:14,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:14,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:14,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:14,233 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:14,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-20 08:54:14,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-20 08:54:14,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:14,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-20 08:54:14,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:14,235 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:14,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:14,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-20 08:54:14,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:14,238 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:14,238 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-20 08:54:14,238 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-20 08:54:14,238 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:14,238 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-20 08:54:14,238 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:14,238 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:14,238 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-11-20 08:54:14,238 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-20 08:54:14,238 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-11-20 08:54:14,238 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:54:14,238 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-20 08:54:14,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:14,238 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:14,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:14,239 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-11-20 08:54:14,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:14,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:14,239 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:54:14,339 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:54:14,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:54:14,344 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:54:14,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testScannerOnBulkLoadRefHFiles was in running list but was completed. Accepting new attempt. 2023-11-20 08:54:14,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-11-20 08:54:14,346 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-11-20 08:54:14,346 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:14,346 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-11-20 08:54:14,346 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-11-20 08:54:14,347 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-20 08:54:14,347 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-20 08:54:14,348 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:14,348 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:14,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:14,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:14,349 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:14,349 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:54:14,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-20 08:54:14,349 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-20 08:54:14,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:54:14,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-20 08:54:14,350 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-11-20 08:54:14,350 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testScannerOnBulkLoadRefHFiles is still present, removing 2023-11-20 08:54:14,350 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-11-20 08:54:14,351 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-11-20 08:54:14,351 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:14,351 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-11-20 08:54:14,351 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1700470451259.53dd3cf22f6da76994961de186109db6. 2023-11-20 08:54:14,351 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1700470451259.53dd3cf22f6da76994961de186109db6. started... 2023-11-20 08:54:14,351 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1700470451259.32148f74faef43fe3181334f58210602. 2023-11-20 08:54:14,351 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 53dd3cf22f6da76994961de186109db6: 2023-11-20 08:54:14,351 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1700470451259.32148f74faef43fe3181334f58210602. started... 2023-11-20 08:54:14,351 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1700470451259.53dd3cf22f6da76994961de186109db6. 2023-11-20 08:54:14,351 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 32148f74faef43fe3181334f58210602: 2023-11-20 08:54:14,351 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1700470451259.32148f74faef43fe3181334f58210602. 2023-11-20 08:54:14,351 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-20 08:54:14,351 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:54:14,352 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-20 08:54:14,352 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1700470451259.612548ffeca5aef6aedcb4899d4e1a66. 2023-11-20 08:54:14,352 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-20 08:54:14,352 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1700470451259.612548ffeca5aef6aedcb4899d4e1a66. started... 2023-11-20 08:54:14,352 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 612548ffeca5aef6aedcb4899d4e1a66 2/2 column families, dataSize=90 B heapSize=752 B 2023-11-20 08:54:14,767 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023112089d07f24f00a4635b870ed8322d3d826 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c2023112089d07f24f00a4635b870ed8322d3d826 2023-11-20 08:54:15,173 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=90, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testScannerOnBulkLoadRefHFiles/612548ffeca5aef6aedcb4899d4e1a66/.tmp/family1/23c86f88f8334f1bac220b66dd678c64 2023-11-20 08:54:15,178 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testScannerOnBulkLoadRefHFiles/612548ffeca5aef6aedcb4899d4e1a66/.tmp/family1/23c86f88f8334f1bac220b66dd678c64 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testScannerOnBulkLoadRefHFiles/612548ffeca5aef6aedcb4899d4e1a66/family1/23c86f88f8334f1bac220b66dd678c64 2023-11-20 08:54:15,183 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testScannerOnBulkLoadRefHFiles/612548ffeca5aef6aedcb4899d4e1a66/family1/23c86f88f8334f1bac220b66dd678c64, entries=2, sequenceid=9, filesize=5.0 K 2023-11-20 08:54:15,184 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~90 B/90, heapSize ~480 B/480, currentSize=0 B/0 for 612548ffeca5aef6aedcb4899d4e1a66 in 832ms, sequenceid=9, compaction requested=false 2023-11-20 08:54:15,184 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 612548ffeca5aef6aedcb4899d4e1a66: 2023-11-20 08:54:15,184 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1700470451259.612548ffeca5aef6aedcb4899d4e1a66. 2023-11-20 08:54:15,184 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-20 08:54:15,184 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-20 08:54:15,184 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:15,184 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-11-20 08:54:15,184 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-11-20 08:54:15,186 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:15,186 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-20 08:54:15,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:15,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:15,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:15,187 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-20 08:54:15,187 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:54:15,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:15,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:15,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-20 08:54:15,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:15,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:15,188 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-11-20 08:54:15,188 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7f5f8850[Count = 0] remaining members to acquire global barrier 2023-11-20 08:54:15,188 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-11-20 08:54:15,188 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-20 08:54:15,190 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-20 08:54:15,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-20 08:54:15,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-20 08:54:15,190 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-11-20 08:54:15,190 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-11-20 08:54:15,191 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:54:15,191 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:15,191 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:54:15,192 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-11-20 08:54:15,192 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:15,192 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:15,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:15,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:15,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:15,192 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-11-20 08:54:15,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:15,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:15,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-20 08:54:15,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:15,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:15,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-20 08:54:15,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:15,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:54:15,195 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-11-20 08:54:15,195 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-11-20 08:54:15,195 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:54:15,195 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:54:15,195 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-11-20 08:54:15,195 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:54:15,197 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-20 08:54:15,197 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-20 08:54:15,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-20 08:54:15,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:15,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:15,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-20 08:54:15,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-20 08:54:15,197 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:15,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:15,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:15,198 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:15,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:15,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-20 08:54:15,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-20 08:54:15,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:15,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-20 08:54:15,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:15,199 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:15,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:15,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-20 08:54:15,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:15,207 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:15,207 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:15,207 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-20 08:54:15,207 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:15,207 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-11-20 08:54:15,207 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:54:15,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:15,207 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:15,207 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-20 08:54:15,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:15,208 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-11-20 08:54:15,208 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:15,208 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:54:15,208 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-20 08:54:15,208 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-20 08:54:15,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:15,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:15,208 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-20 08:54:15,308 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:54:15,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:54:15,316 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=36169] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testScannerOnBulkLoadRefHFiles 2023-11-20 08:54:15,317 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-11-20 08:54:15,318 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-11-20 08:54:15,319 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] mob.MobUtils(833): start MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-20 08:54:15,319 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700471055319 2023-11-20 08:54:15,319 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-20 08:54:15,320 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testScannerOnBulkLoadRefHFiles' and column 'family1' 2023-11-20 08:54:15,320 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-20 08:54:15,321 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] zookeeper.ReadOnlyZKClient(139): Connect 0x4d88c6db to 127.0.0.1:64635 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-20 08:54:15,325 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1a36c369, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-20 08:54:15,325 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231120 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-11-20 08:54:16,153 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231120dfe114309ca84a3ba77756e1c60646dd to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231120dfe114309ca84a3ba77756e1c60646dd 2023-11-20 08:54:16,154 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231120 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-20 08:54:16,168 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-20 08:54:16,169 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49530, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-20 08:54:16,176 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-20 08:54:16,178 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41524, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-20 08:54:16,187 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231120/family1/72c8291848464ce5b36f21b0cf625849 first=Optional[k0] last=Optional[k1] 2023-11-20 08:54:16,188 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testScannerOnBulkLoadRefHFiles,2,1700470451259.612548ffeca5aef6aedcb4899d4e1a66., hostname=jenkins-hbase4.apache.org,38491,1700470412215, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231120/family1/72c8291848464ce5b36f21b0cf625849}] 2023-11-20 08:54:16,193 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(763): Validating hfile at hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231120/family1/72c8291848464ce5b36f21b0cf625849 for inclusion in 612548ffeca5aef6aedcb4899d4e1a66/family1 2023-11-20 08:54:16,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(775): HFile bounds: first=k0 last=k1 2023-11-20 08:54:16,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-20 08:54:16,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HRegion(2446): Flush status journal for 612548ffeca5aef6aedcb4899d4e1a66: 2023-11-20 08:54:16,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231120/family1/72c8291848464ce5b36f21b0cf625849 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testScannerOnBulkLoadRefHFiles__ecqctjrhvq60abp86eidaca566bf0jtf9lqt1uvpc0llst3bnn8b38b21arh3tuh/family1/72c8291848464ce5b36f21b0cf625849 2023-11-20 08:54:16,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testScannerOnBulkLoadRefHFiles__ecqctjrhvq60abp86eidaca566bf0jtf9lqt1uvpc0llst3bnn8b38b21arh3tuh/family1/72c8291848464ce5b36f21b0cf625849 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testScannerOnBulkLoadRefHFiles/612548ffeca5aef6aedcb4899d4e1a66/family1/39751fce885f41379682f5e9d93aad28_SeqId_12_ 2023-11-20 08:54:16,200 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(849): Loaded HFile hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testScannerOnBulkLoadRefHFiles__ecqctjrhvq60abp86eidaca566bf0jtf9lqt1uvpc0llst3bnn8b38b21arh3tuh/family1/72c8291848464ce5b36f21b0cf625849 into 612548ffeca5aef6aedcb4899d4e1a66/family1 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testScannerOnBulkLoadRefHFiles/612548ffeca5aef6aedcb4899d4e1a66/family1/39751fce885f41379682f5e9d93aad28_SeqId_12_ - updating store file list. 2023-11-20 08:54:16,204 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(882): Loaded HFile hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testScannerOnBulkLoadRefHFiles/612548ffeca5aef6aedcb4899d4e1a66/family1/39751fce885f41379682f5e9d93aad28_SeqId_12_ into 612548ffeca5aef6aedcb4899d4e1a66/family1 2023-11-20 08:54:16,204 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(855): Successfully loaded hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testScannerOnBulkLoadRefHFiles__ecqctjrhvq60abp86eidaca566bf0jtf9lqt1uvpc0llst3bnn8b38b21arh3tuh/family1/72c8291848464ce5b36f21b0cf625849 into 612548ffeca5aef6aedcb4899d4e1a66/family1 (new location: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testScannerOnBulkLoadRefHFiles/612548ffeca5aef6aedcb4899d4e1a66/family1/39751fce885f41379682f5e9d93aad28_SeqId_12_) 2023-11-20 08:54:16,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testScannerOnBulkLoadRefHFiles__ecqctjrhvq60abp86eidaca566bf0jtf9lqt1uvpc0llst3bnn8b38b21arh3tuh/family1/72c8291848464ce5b36f21b0cf625849 2023-11-20 08:54:16,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-20 08:54:16,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 15445 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-20 08:54:16,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(1912): 612548ffeca5aef6aedcb4899d4e1a66/family1 is initiating minor compaction (all files) 2023-11-20 08:54:16,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@63a1a776; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-20 08:54:16,206 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 612548ffeca5aef6aedcb4899d4e1a66/family1 in testScannerOnBulkLoadRefHFiles,2,1700470451259.612548ffeca5aef6aedcb4899d4e1a66. 2023-11-20 08:54:16,206 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testScannerOnBulkLoadRefHFiles/612548ffeca5aef6aedcb4899d4e1a66/family1/e58778c258544d40a41b8cd55e269e2e, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testScannerOnBulkLoadRefHFiles/612548ffeca5aef6aedcb4899d4e1a66/family1/23c86f88f8334f1bac220b66dd678c64, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testScannerOnBulkLoadRefHFiles/612548ffeca5aef6aedcb4899d4e1a66/family1/39751fce885f41379682f5e9d93aad28_SeqId_12_] into tmpdir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testScannerOnBulkLoadRefHFiles/612548ffeca5aef6aedcb4899d4e1a66/.tmp, totalSize=15.1 K 2023-11-20 08:54:16,206 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting e58778c258544d40a41b8cd55e269e2e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700470453369 2023-11-20 08:54:16,207 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting 23c86f88f8334f1bac220b66dd678c64, keycount=2, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700470453369 2023-11-20 08:54:16,207 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting 39751fce885f41379682f5e9d93aad28_SeqId_12_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700470453369 2023-11-20 08:54:16,208 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231120 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-20 08:54:16,209 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:54:16,210 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c2023112089d07f24f00a4635b870ed8322d3d826 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c2023112089d07f24f00a4635b870ed8322d3d826 2023-11-20 08:54:16,211 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231120ccee5b8e83dc456fbd334cec3701afc8 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231120ccee5b8e83dc456fbd334cec3701afc8 2023-11-20 08:54:16,212 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testScannerOnBulkLoadRefHFiles 2 expired mob files are deleted 2023-11-20 08:54:16,212 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231120' 2023-11-20 08:54:16,212 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231120 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-11-20 08:54:16,212 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-20 08:54:16,212 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] mob.MobUtils(840): end MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-20 08:54:16,213 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-11-20 08:54:16,215 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE in 897 msec 2023-11-20 08:54:16,218 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] throttle.PressureAwareThroughputController(145): 612548ffeca5aef6aedcb4899d4e1a66#family1#compaction#37 average throughput is 0.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-20 08:54:16,251 INFO [Listener at localhost/43513] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=261 (was 265), OpenFileDescriptor=665 (was 665), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=189 (was 204), ProcessCount=170 (was 170), AvailableMemoryMB=14817 (was 14854) 2023-11-20 08:54:16,261 INFO [Listener at localhost/43513] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=261, OpenFileDescriptor=665, MaxFileDescriptor=60000, SystemLoadAverage=189, ProcessCount=170, AvailableMemoryMB=14816 2023-11-20 08:54:16,263 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-20 08:54:16,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:16,265 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-20 08:54:16,265 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyPolicy" procId is: 35 2023-11-20 08:54:16,265 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-20 08:54:16,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-20 08:54:16,267 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2 2023-11-20 08:54:16,267 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2 empty. 2023-11-20 08:54:16,267 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2 2023-11-20 08:54:16,268 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyPolicy regions 2023-11-20 08:54:16,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-20 08:54:16,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-20 08:54:16,675 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-20 08:54:16,677 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => ebc91fbf023be453f933eaa5806158e2, NAME => 'testMajorCompactionWithWeeklyPolicy,,1700470456262.ebc91fbf023be453f933eaa5806158e2.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp 2023-11-20 08:54:16,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-20 08:54:17,083 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1700470456262.ebc91fbf023be453f933eaa5806158e2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-20 08:54:17,083 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing ebc91fbf023be453f933eaa5806158e2, disabling compactions & flushes 2023-11-20 08:54:17,083 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1700470456262.ebc91fbf023be453f933eaa5806158e2. 2023-11-20 08:54:17,083 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1700470456262.ebc91fbf023be453f933eaa5806158e2. 2023-11-20 08:54:17,083 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1700470456262.ebc91fbf023be453f933eaa5806158e2. after waiting 0 ms 2023-11-20 08:54:17,083 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1700470456262.ebc91fbf023be453f933eaa5806158e2. 2023-11-20 08:54:17,083 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1700470456262.ebc91fbf023be453f933eaa5806158e2. 2023-11-20 08:54:17,083 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for ebc91fbf023be453f933eaa5806158e2: 2023-11-20 08:54:17,086 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-20 08:54:17,087 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyPolicy,,1700470456262.ebc91fbf023be453f933eaa5806158e2.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1700470457087"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700470457087"}]},"ts":"1700470457087"} 2023-11-20 08:54:17,088 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-20 08:54:17,089 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-20 08:54:17,089 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700470457089"}]},"ts":"1700470457089"} 2023-11-20 08:54:17,090 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-11-20 08:54:17,093 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=ebc91fbf023be453f933eaa5806158e2, ASSIGN}] 2023-11-20 08:54:17,095 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=ebc91fbf023be453f933eaa5806158e2, ASSIGN 2023-11-20 08:54:17,095 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=ebc91fbf023be453f933eaa5806158e2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38491,1700470412215; forceNewPlan=false, retain=false 2023-11-20 08:54:17,246 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=ebc91fbf023be453f933eaa5806158e2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:17,247 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyPolicy,,1700470456262.ebc91fbf023be453f933eaa5806158e2.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1700470457246"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700470457246"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700470457246"}]},"ts":"1700470457246"} 2023-11-20 08:54:17,248 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; OpenRegionProcedure ebc91fbf023be453f933eaa5806158e2, server=jenkins-hbase4.apache.org,38491,1700470412215}] 2023-11-20 08:54:17,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-20 08:54:17,400 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:17,403 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyPolicy,,1700470456262.ebc91fbf023be453f933eaa5806158e2. 2023-11-20 08:54:17,424 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ebc91fbf023be453f933eaa5806158e2, NAME => 'testMajorCompactionWithWeeklyPolicy,,1700470456262.ebc91fbf023be453f933eaa5806158e2.', STARTKEY => '', ENDKEY => ''} 2023-11-20 08:54:17,425 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyPolicy ebc91fbf023be453f933eaa5806158e2 2023-11-20 08:54:17,425 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1700470456262.ebc91fbf023be453f933eaa5806158e2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-20 08:54:17,425 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-20 08:54:17,425 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ebc91fbf023be453f933eaa5806158e2 2023-11-20 08:54:17,425 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ebc91fbf023be453f933eaa5806158e2 2023-11-20 08:54:17,425 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4d88c6db to 127.0.0.1:64635 2023-11-20 08:54:17,425 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-20 08:54:17,426 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-20 08:54:17,426 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x027fa91e to 127.0.0.1:64635 2023-11-20 08:54:17,426 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-20 08:54:17,427 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-20 08:54:17,427 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x21650ac2 to 127.0.0.1:64635 2023-11-20 08:54:17,427 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-20 08:54:17,427 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-20 08:54:17,427 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3a667848 to 127.0.0.1:64635 2023-11-20 08:54:17,427 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-20 08:54:17,428 INFO [StoreOpener-ebc91fbf023be453f933eaa5806158e2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region ebc91fbf023be453f933eaa5806158e2 2023-11-20 08:54:17,429 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-20 08:54:17,429 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x146262fb to 127.0.0.1:64635 2023-11-20 08:54:17,429 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-20 08:54:17,430 DEBUG [StoreOpener-ebc91fbf023be453f933eaa5806158e2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1 2023-11-20 08:54:17,430 DEBUG [StoreOpener-ebc91fbf023be453f933eaa5806158e2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1 2023-11-20 08:54:17,431 INFO [StoreOpener-ebc91fbf023be453f933eaa5806158e2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ebc91fbf023be453f933eaa5806158e2 columnFamilyName family1 2023-11-20 08:54:17,433 INFO [StoreOpener-ebc91fbf023be453f933eaa5806158e2-1] regionserver.HStore(310): Store=ebc91fbf023be453f933eaa5806158e2/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-20 08:54:17,434 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2 2023-11-20 08:54:17,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2 2023-11-20 08:54:17,439 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ebc91fbf023be453f933eaa5806158e2 2023-11-20 08:54:17,440 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testScannerOnBulkLoadRefHFiles/612548ffeca5aef6aedcb4899d4e1a66/.tmp/family1/2a25241f4f5e4bd19892db780a1379aa as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testScannerOnBulkLoadRefHFiles/612548ffeca5aef6aedcb4899d4e1a66/family1/2a25241f4f5e4bd19892db780a1379aa 2023-11-20 08:54:17,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-20 08:54:17,443 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ebc91fbf023be453f933eaa5806158e2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67570016, jitterRate=0.006871700286865234}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-20 08:54:17,443 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ebc91fbf023be453f933eaa5806158e2: 2023-11-20 08:54:17,444 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyPolicy,,1700470456262.ebc91fbf023be453f933eaa5806158e2., pid=37, masterSystemTime=1700470457400 2023-11-20 08:54:17,447 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyPolicy,,1700470456262.ebc91fbf023be453f933eaa5806158e2. 2023-11-20 08:54:17,447 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyPolicy,,1700470456262.ebc91fbf023be453f933eaa5806158e2. 2023-11-20 08:54:17,447 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 612548ffeca5aef6aedcb4899d4e1a66/family1 of 612548ffeca5aef6aedcb4899d4e1a66 into 2a25241f4f5e4bd19892db780a1379aa(size=5.1 K), total size for store is 5.1 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-20 08:54:17,447 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 612548ffeca5aef6aedcb4899d4e1a66: 2023-11-20 08:54:17,447 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=ebc91fbf023be453f933eaa5806158e2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:17,447 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testScannerOnBulkLoadRefHFiles,2,1700470451259.612548ffeca5aef6aedcb4899d4e1a66., storeName=family1, fileCount=3, fileSize=15.1 K (4.9 K, 5.0 K, 5.2 K), priority=2, time=1700470456206; duration=1sec 2023-11-20 08:54:17,448 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyPolicy,,1700470456262.ebc91fbf023be453f933eaa5806158e2.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1700470457447"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700470457447"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700470457447"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700470457447"}]},"ts":"1700470457447"} 2023-11-20 08:54:17,448 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-20 08:54:17,451 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=37, resume processing ppid=36 2023-11-20 08:54:17,451 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; OpenRegionProcedure ebc91fbf023be453f933eaa5806158e2, server=jenkins-hbase4.apache.org,38491,1700470412215 in 201 msec 2023-11-20 08:54:17,453 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=36, resume processing ppid=35 2023-11-20 08:54:17,453 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=ebc91fbf023be453f933eaa5806158e2, ASSIGN in 358 msec 2023-11-20 08:54:17,453 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-20 08:54:17,453 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700470457453"}]},"ts":"1700470457453"} 2023-11-20 08:54:17,454 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-11-20 08:54:17,457 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-20 08:54:17,459 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy in 1.1940 sec 2023-11-20 08:54:17,505 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testScannerOnBulkLoadRefHFiles/612548ffeca5aef6aedcb4899d4e1a66/family1/e58778c258544d40a41b8cd55e269e2e, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testScannerOnBulkLoadRefHFiles/612548ffeca5aef6aedcb4899d4e1a66/family1/23c86f88f8334f1bac220b66dd678c64, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testScannerOnBulkLoadRefHFiles/612548ffeca5aef6aedcb4899d4e1a66/family1/39751fce885f41379682f5e9d93aad28_SeqId_12_] to archive 2023-11-20 08:54:17,506 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:54:17,507 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testScannerOnBulkLoadRefHFiles/612548ffeca5aef6aedcb4899d4e1a66/family1/e58778c258544d40a41b8cd55e269e2e to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testScannerOnBulkLoadRefHFiles/612548ffeca5aef6aedcb4899d4e1a66/family1/e58778c258544d40a41b8cd55e269e2e 2023-11-20 08:54:17,508 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testScannerOnBulkLoadRefHFiles/612548ffeca5aef6aedcb4899d4e1a66/family1/23c86f88f8334f1bac220b66dd678c64 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testScannerOnBulkLoadRefHFiles/612548ffeca5aef6aedcb4899d4e1a66/family1/23c86f88f8334f1bac220b66dd678c64 2023-11-20 08:54:17,509 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testScannerOnBulkLoadRefHFiles/612548ffeca5aef6aedcb4899d4e1a66/family1/39751fce885f41379682f5e9d93aad28_SeqId_12_ to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testScannerOnBulkLoadRefHFiles/612548ffeca5aef6aedcb4899d4e1a66/family1/39751fce885f41379682f5e9d93aad28_SeqId_12_ 2023-11-20 08:54:17,965 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-20 08:54:18,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-20 08:54:18,371 INFO [Listener at localhost/43513] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyPolicy, procId: 35 completed 2023-11-20 08:54:18,393 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:54:18,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:18,395 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-20 08:54:18,395 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:18,395 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-20 08:54:18,395 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-20 08:54:18,395 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:18,395 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:18,398 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:18,398 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:18,398 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:18,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:18,398 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:18,398 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:54:18,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:18,399 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:18,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:54:18,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:18,399 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:18,400 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:18,400 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-20 08:54:18,400 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:18,400 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-20 08:54:18,400 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-20 08:54:18,400 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:54:18,400 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700470456262.ebc91fbf023be453f933eaa5806158e2. 2023-11-20 08:54:18,400 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700470456262.ebc91fbf023be453f933eaa5806158e2. started... 2023-11-20 08:54:18,400 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ebc91fbf023be453f933eaa5806158e2 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-20 08:54:18,419 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511306c27a3bc7ce1411485406d3d50f0b19f to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511306c27a3bc7ce1411485406d3d50f0b19f 2023-11-20 08:54:18,422 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/.tmp/family1/fec155405d874f0e873b276213e166ff 2023-11-20 08:54:18,427 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/.tmp/family1/fec155405d874f0e873b276213e166ff as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/fec155405d874f0e873b276213e166ff 2023-11-20 08:54:18,431 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/fec155405d874f0e873b276213e166ff, entries=1000, sequenceid=5, filesize=165.1 K 2023-11-20 08:54:18,431 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for ebc91fbf023be453f933eaa5806158e2 in 31ms, sequenceid=5, compaction requested=false 2023-11-20 08:54:18,431 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyPolicy' 2023-11-20 08:54:18,432 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ebc91fbf023be453f933eaa5806158e2: 2023-11-20 08:54:18,432 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700470456262.ebc91fbf023be453f933eaa5806158e2. 2023-11-20 08:54:18,432 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-20 08:54:18,432 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-20 08:54:18,432 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:18,432 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-20 08:54:18,432 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-20 08:54:18,434 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:18,434 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:18,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:18,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:18,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:18,434 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:18,434 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:54:18,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:18,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:18,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:18,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:18,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:18,435 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-20 08:54:18,436 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@67cbd648[Count = 0] remaining members to acquire global barrier 2023-11-20 08:54:18,436 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-20 08:54:18,436 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:18,437 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:18,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:18,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:18,437 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-20 08:54:18,437 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-20 08:54:18,437 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:54:18,437 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:18,437 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:54:18,439 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:18,439 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-20 08:54:18,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:18,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:18,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:18,439 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:18,439 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-20 08:54:18,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:18,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:18,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:18,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:18,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:18,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:18,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:18,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:54:18,441 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-20 08:54:18,441 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-20 08:54:18,441 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:54:18,441 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:54:18,441 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:18,441 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:54:18,444 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:18,444 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:18,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:18,444 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:18,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:18,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:18,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:18,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:18,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:18,445 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:18,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:18,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:18,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:18,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:18,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:18,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:18,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:18,446 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:18,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:18,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:18,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:18,449 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:18,449 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:18,449 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:18,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:18,449 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-20 08:54:18,449 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:54:18,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:18,449 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:18,449 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:18,449 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:18,449 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:18,449 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:18,449 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:18,449 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:18,449 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-20 08:54:18,449 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:54:18,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:18,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:18,549 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:54:18,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:54:18,554 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:54:18,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-20 08:54:18,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:18,556 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-20 08:54:18,556 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:18,556 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-20 08:54:18,556 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-20 08:54:18,556 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:18,556 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:18,558 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:18,558 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:18,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:18,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:18,558 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:18,558 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:54:18,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:18,558 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:18,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:54:18,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:18,559 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:18,559 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-20 08:54:18,559 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:18,559 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-20 08:54:18,559 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:18,559 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-20 08:54:18,559 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-20 08:54:18,559 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:54:18,559 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700470456262.ebc91fbf023be453f933eaa5806158e2. 2023-11-20 08:54:18,559 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700470456262.ebc91fbf023be453f933eaa5806158e2. started... 2023-11-20 08:54:18,559 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ebc91fbf023be453f933eaa5806158e2 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-20 08:54:18,972 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511284d02f3e9242e4c22b26002bd6df908c4 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511284d02f3e9242e4c22b26002bd6df908c4 2023-11-20 08:54:19,377 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/.tmp/family1/14e401ee9a3a4b4f905797045efd51ac 2023-11-20 08:54:19,382 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/.tmp/family1/14e401ee9a3a4b4f905797045efd51ac as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/14e401ee9a3a4b4f905797045efd51ac 2023-11-20 08:54:19,387 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/14e401ee9a3a4b4f905797045efd51ac, entries=1, sequenceid=9, filesize=5.0 K 2023-11-20 08:54:19,387 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for ebc91fbf023be453f933eaa5806158e2 in 828ms, sequenceid=9, compaction requested=false 2023-11-20 08:54:19,388 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ebc91fbf023be453f933eaa5806158e2: 2023-11-20 08:54:19,388 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700470456262.ebc91fbf023be453f933eaa5806158e2. 2023-11-20 08:54:19,388 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-20 08:54:19,388 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-20 08:54:19,388 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:19,388 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-20 08:54:19,388 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-20 08:54:19,390 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:19,390 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:19,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:19,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:19,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:19,390 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:19,390 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:54:19,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:19,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:19,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:19,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:19,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:19,392 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-20 08:54:19,392 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@488e94ac[Count = 0] remaining members to acquire global barrier 2023-11-20 08:54:19,392 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-20 08:54:19,392 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:19,393 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:19,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:19,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:19,394 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-20 08:54:19,394 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-20 08:54:19,394 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:54:19,394 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:19,394 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:54:19,396 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:19,396 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-20 08:54:19,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:19,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:19,396 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:19,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:19,396 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-20 08:54:19,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:19,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:19,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:19,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:19,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:19,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:19,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:19,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:54:19,398 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-20 08:54:19,398 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-20 08:54:19,398 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:54:19,398 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:54:19,398 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:19,398 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:54:19,400 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:19,400 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:19,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:19,400 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:19,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:19,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:19,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:19,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:19,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:19,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:19,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:19,401 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:19,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:19,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:19,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:19,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:19,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:19,403 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:19,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:19,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:19,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:19,408 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:19,408 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:19,408 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:19,408 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:19,408 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:19,408 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:19,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:19,408 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-20 08:54:19,409 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:54:19,408 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:19,409 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:19,409 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:19,409 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:19,409 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:19,409 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-20 08:54:19,409 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:54:19,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:19,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:19,509 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:54:19,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:54:19,513 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:54:19,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-20 08:54:19,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:19,515 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-20 08:54:19,515 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:19,515 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-20 08:54:19,515 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-20 08:54:19,515 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:19,516 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:19,517 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:19,517 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:19,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:19,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:19,518 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:19,518 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:54:19,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:19,518 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:19,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:54:19,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:19,519 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:19,519 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-20 08:54:19,519 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:19,519 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-20 08:54:19,519 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:19,519 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-20 08:54:19,519 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-20 08:54:19,519 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:54:19,519 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700470456262.ebc91fbf023be453f933eaa5806158e2. 2023-11-20 08:54:19,519 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700470456262.ebc91fbf023be453f933eaa5806158e2. started... 2023-11-20 08:54:19,519 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ebc91fbf023be453f933eaa5806158e2 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-20 08:54:19,932 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201f353cb13b12b415b86a15f71b5af127a to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201f353cb13b12b415b86a15f71b5af127a 2023-11-20 08:54:20,337 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/.tmp/family1/40e52f08d1c644c491516548846e141f 2023-11-20 08:54:20,342 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/.tmp/family1/40e52f08d1c644c491516548846e141f as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/40e52f08d1c644c491516548846e141f 2023-11-20 08:54:20,346 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/40e52f08d1c644c491516548846e141f, entries=1, sequenceid=13, filesize=4.9 K 2023-11-20 08:54:20,347 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ebc91fbf023be453f933eaa5806158e2 in 828ms, sequenceid=13, compaction requested=true 2023-11-20 08:54:20,347 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ebc91fbf023be453f933eaa5806158e2: 2023-11-20 08:54:20,347 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700470456262.ebc91fbf023be453f933eaa5806158e2. 2023-11-20 08:54:20,347 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-20 08:54:20,347 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-20 08:54:20,347 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:20,347 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-20 08:54:20,347 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-20 08:54:20,349 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:20,349 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:20,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:20,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:20,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:20,350 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:20,350 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:54:20,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:20,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:20,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:20,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:20,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:20,351 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-20 08:54:20,351 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3053fe95[Count = 0] remaining members to acquire global barrier 2023-11-20 08:54:20,351 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-20 08:54:20,351 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:20,353 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:20,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:20,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:20,353 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-20 08:54:20,354 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-20 08:54:20,354 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:54:20,354 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:20,354 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:54:20,356 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:20,356 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-20 08:54:20,356 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:20,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:20,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:20,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:20,356 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-20 08:54:20,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:20,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:20,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:20,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:20,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:20,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:20,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:20,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:54:20,359 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-20 08:54:20,359 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-20 08:54:20,359 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:54:20,359 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:54:20,359 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:20,359 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:54:20,360 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:20,360 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:20,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:20,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:20,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:20,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:20,360 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:20,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:20,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:20,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:20,361 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:20,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:20,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:20,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:20,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:20,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:20,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:20,362 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:20,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:20,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:20,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:20,365 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:20,365 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:20,365 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:20,365 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:20,365 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:20,365 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:20,365 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:20,365 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:20,365 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-20 08:54:20,365 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:54:20,365 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-20 08:54:20,366 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:54:20,370 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:20,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:20,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:20,370 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:20,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:20,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:20,466 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:54:20,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:54:20,470 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:54:20,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-20 08:54:20,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:20,472 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-20 08:54:20,472 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:20,472 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-20 08:54:20,472 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-20 08:54:20,473 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:20,473 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:20,474 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:20,474 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:20,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:20,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:20,474 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:20,475 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:54:20,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:20,475 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:20,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:54:20,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:20,475 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:20,475 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-20 08:54:20,476 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:20,476 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-20 08:54:20,476 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:20,476 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-20 08:54:20,476 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-20 08:54:20,476 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:54:20,476 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700470456262.ebc91fbf023be453f933eaa5806158e2. 2023-11-20 08:54:20,476 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700470456262.ebc91fbf023be453f933eaa5806158e2. started... 2023-11-20 08:54:20,476 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ebc91fbf023be453f933eaa5806158e2 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-20 08:54:20,888 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512055f851b3e388b498cae51f175d78e8baf to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512055f851b3e388b498cae51f175d78e8baf 2023-11-20 08:54:21,294 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/.tmp/family1/04fdf3e1c5854dbcaff0447097a565c3 2023-11-20 08:54:21,298 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/.tmp/family1/04fdf3e1c5854dbcaff0447097a565c3 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/04fdf3e1c5854dbcaff0447097a565c3 2023-11-20 08:54:21,303 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/04fdf3e1c5854dbcaff0447097a565c3, entries=1, sequenceid=17, filesize=4.9 K 2023-11-20 08:54:21,303 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ebc91fbf023be453f933eaa5806158e2 in 827ms, sequenceid=17, compaction requested=true 2023-11-20 08:54:21,303 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ebc91fbf023be453f933eaa5806158e2: 2023-11-20 08:54:21,304 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700470456262.ebc91fbf023be453f933eaa5806158e2. 2023-11-20 08:54:21,304 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-20 08:54:21,304 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-20 08:54:21,304 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:21,304 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-20 08:54:21,304 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-20 08:54:21,306 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:21,306 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:21,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:21,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:21,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:21,306 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:21,306 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:54:21,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:21,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:21,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:21,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:21,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:21,308 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-20 08:54:21,308 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@33cdedc7[Count = 0] remaining members to acquire global barrier 2023-11-20 08:54:21,308 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-20 08:54:21,308 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:21,310 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:21,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:21,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:21,310 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-20 08:54:21,310 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-20 08:54:21,310 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:54:21,310 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:21,310 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:54:21,311 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:21,311 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-20 08:54:21,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:21,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:21,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:21,311 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:21,311 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-20 08:54:21,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:21,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:21,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:21,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:21,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:21,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:21,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:21,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:54:21,314 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-20 08:54:21,314 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-20 08:54:21,314 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:54:21,314 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:54:21,314 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:21,314 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:54:21,316 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:21,316 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:21,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:21,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:21,316 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:21,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:21,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:21,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:21,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:21,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:21,316 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:21,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:21,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:21,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:21,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:21,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:21,317 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:21,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:21,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:21,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:21,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:21,321 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:21,321 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:21,321 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:21,321 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:21,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:21,321 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:21,321 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-20 08:54:21,321 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:54:21,321 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:21,321 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:21,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:21,321 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:21,322 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-20 08:54:21,322 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-20 08:54:21,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:21,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:21,322 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:54:21,322 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:21,322 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:21,422 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:54:21,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:54:21,427 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:54:21,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-20 08:54:21,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:21,429 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-20 08:54:21,429 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:21,429 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-20 08:54:21,429 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-20 08:54:21,429 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:21,429 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:21,430 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:21,430 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:21,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:21,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:21,431 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:21,431 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:54:21,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:21,431 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:21,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:54:21,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:21,431 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:21,432 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-20 08:54:21,432 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:21,432 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-20 08:54:21,432 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:21,432 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-20 08:54:21,432 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-20 08:54:21,432 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:54:21,432 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700470456262.ebc91fbf023be453f933eaa5806158e2. 2023-11-20 08:54:21,432 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700470456262.ebc91fbf023be453f933eaa5806158e2. started... 2023-11-20 08:54:21,432 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ebc91fbf023be453f933eaa5806158e2 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-20 08:54:21,845 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228a05a1bc763944fac9e47fc846956a3a8 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228a05a1bc763944fac9e47fc846956a3a8 2023-11-20 08:54:22,251 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/.tmp/family1/b0c042a9bd18443599b819fb987606dc 2023-11-20 08:54:22,255 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/.tmp/family1/b0c042a9bd18443599b819fb987606dc as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/b0c042a9bd18443599b819fb987606dc 2023-11-20 08:54:22,259 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/b0c042a9bd18443599b819fb987606dc, entries=1, sequenceid=21, filesize=4.9 K 2023-11-20 08:54:22,260 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ebc91fbf023be453f933eaa5806158e2 in 828ms, sequenceid=21, compaction requested=true 2023-11-20 08:54:22,260 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ebc91fbf023be453f933eaa5806158e2: 2023-11-20 08:54:22,260 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700470456262.ebc91fbf023be453f933eaa5806158e2. 2023-11-20 08:54:22,260 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-20 08:54:22,260 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-20 08:54:22,260 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:22,260 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-20 08:54:22,260 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-20 08:54:22,262 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:22,262 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:22,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:22,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:22,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:22,263 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:22,263 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:54:22,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:22,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:22,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:22,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:22,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:22,264 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-20 08:54:22,264 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@a0d1460[Count = 0] remaining members to acquire global barrier 2023-11-20 08:54:22,264 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-20 08:54:22,264 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:22,265 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:22,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:22,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:22,265 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-20 08:54:22,266 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-20 08:54:22,266 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:54:22,266 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:22,266 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:54:22,268 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-20 08:54:22,268 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:22,268 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:22,268 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-20 08:54:22,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:22,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:22,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:22,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:22,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:22,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:22,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:22,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:22,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:22,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:22,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:54:22,270 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-20 08:54:22,270 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-20 08:54:22,271 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:54:22,271 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:54:22,271 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:22,271 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:54:22,275 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:22,275 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:22,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:22,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:22,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:22,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:22,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:22,275 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:22,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:22,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:22,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:22,275 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:22,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:22,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:22,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:22,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:22,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:22,277 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:22,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:22,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:22,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:22,279 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:22,279 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:22,279 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:22,279 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:22,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:22,279 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:22,279 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:22,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:22,279 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-20 08:54:22,279 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:54:22,279 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:22,280 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:22,280 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:22,280 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:22,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:22,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:22,280 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-20 08:54:22,280 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:54:22,380 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:54:22,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:54:22,384 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:54:22,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-20 08:54:22,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:22,386 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-20 08:54:22,386 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:22,386 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-20 08:54:22,386 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-20 08:54:22,387 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:22,387 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:22,389 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:22,389 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:22,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:22,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:22,389 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:22,389 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:54:22,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:22,390 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:22,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:54:22,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:22,390 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:22,390 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-20 08:54:22,390 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:22,390 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-20 08:54:22,390 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:22,390 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-20 08:54:22,390 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-20 08:54:22,390 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:54:22,390 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700470456262.ebc91fbf023be453f933eaa5806158e2. 2023-11-20 08:54:22,391 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700470456262.ebc91fbf023be453f933eaa5806158e2. started... 2023-11-20 08:54:22,391 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ebc91fbf023be453f933eaa5806158e2 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-20 08:54:22,803 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231fca7bbed728c4afda3d9d3aafaee2143 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231fca7bbed728c4afda3d9d3aafaee2143 2023-11-20 08:54:22,926 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-20 08:54:23,208 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/.tmp/family1/33d2ed77df914e268f854ea0db7cfb4a 2023-11-20 08:54:23,213 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/.tmp/family1/33d2ed77df914e268f854ea0db7cfb4a as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/33d2ed77df914e268f854ea0db7cfb4a 2023-11-20 08:54:23,217 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/33d2ed77df914e268f854ea0db7cfb4a, entries=1, sequenceid=25, filesize=4.9 K 2023-11-20 08:54:23,218 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ebc91fbf023be453f933eaa5806158e2 in 827ms, sequenceid=25, compaction requested=true 2023-11-20 08:54:23,218 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ebc91fbf023be453f933eaa5806158e2: 2023-11-20 08:54:23,218 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700470456262.ebc91fbf023be453f933eaa5806158e2. 2023-11-20 08:54:23,218 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-20 08:54:23,218 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-20 08:54:23,218 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:23,218 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-20 08:54:23,218 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-20 08:54:23,220 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:23,220 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:23,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:23,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:23,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:23,221 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:23,221 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:54:23,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:23,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:23,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:23,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:23,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:23,222 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-20 08:54:23,222 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@361aca79[Count = 0] remaining members to acquire global barrier 2023-11-20 08:54:23,222 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-20 08:54:23,222 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:23,223 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:23,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:23,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:23,223 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-20 08:54:23,223 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-20 08:54:23,223 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:54:23,223 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:23,224 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:54:23,225 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:23,225 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-20 08:54:23,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:23,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:23,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:23,225 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:23,225 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-20 08:54:23,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:23,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:23,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:23,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:23,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:23,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:23,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:23,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:54:23,227 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-20 08:54:23,227 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-20 08:54:23,228 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:54:23,228 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:54:23,228 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:23,228 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:54:23,230 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:23,230 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:23,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:23,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:23,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:23,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:23,230 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:23,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:23,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:23,231 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:23,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:23,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:23,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:23,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:23,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:23,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:23,232 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:23,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:23,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:23,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:23,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:23,234 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:23,234 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:23,234 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:23,234 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:23,234 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:23,234 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:23,234 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:23,234 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-20 08:54:23,235 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:54:23,234 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:23,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:23,234 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:23,235 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-20 08:54:23,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:23,235 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-20 08:54:23,235 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:23,235 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:54:23,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:23,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:23,335 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:54:23,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:54:23,340 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:54:23,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-20 08:54:23,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:23,342 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-20 08:54:23,342 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:23,342 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-20 08:54:23,342 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-20 08:54:23,342 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:23,342 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:23,343 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:23,343 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:23,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:23,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:23,344 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:23,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:23,344 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:54:23,344 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:23,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:54:23,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:23,345 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:23,345 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-20 08:54:23,345 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:23,345 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-20 08:54:23,345 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:23,345 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-20 08:54:23,345 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-20 08:54:23,345 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:54:23,345 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700470456262.ebc91fbf023be453f933eaa5806158e2. 2023-11-20 08:54:23,345 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700470456262.ebc91fbf023be453f933eaa5806158e2. started... 2023-11-20 08:54:23,345 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ebc91fbf023be453f933eaa5806158e2 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-20 08:54:23,757 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101892978873a064eeb8f78f4753412fd5e to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101892978873a064eeb8f78f4753412fd5e 2023-11-20 08:54:24,162 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/.tmp/family1/b20ecf7f724d41c4af63a358eb0d64be 2023-11-20 08:54:24,167 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/.tmp/family1/b20ecf7f724d41c4af63a358eb0d64be as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/b20ecf7f724d41c4af63a358eb0d64be 2023-11-20 08:54:24,171 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/b20ecf7f724d41c4af63a358eb0d64be, entries=1, sequenceid=29, filesize=4.9 K 2023-11-20 08:54:24,172 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ebc91fbf023be453f933eaa5806158e2 in 827ms, sequenceid=29, compaction requested=true 2023-11-20 08:54:24,172 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ebc91fbf023be453f933eaa5806158e2: 2023-11-20 08:54:24,172 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700470456262.ebc91fbf023be453f933eaa5806158e2. 2023-11-20 08:54:24,172 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-20 08:54:24,173 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-20 08:54:24,173 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:24,173 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-20 08:54:24,173 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-20 08:54:24,174 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:24,174 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:24,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:24,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:24,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:24,175 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:24,175 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:54:24,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:24,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:24,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:24,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:24,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:24,176 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-20 08:54:24,176 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@19123d79[Count = 0] remaining members to acquire global barrier 2023-11-20 08:54:24,176 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-20 08:54:24,176 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:24,178 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:24,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:24,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:24,179 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-20 08:54:24,179 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-20 08:54:24,179 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:54:24,179 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:24,179 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:54:24,180 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-20 08:54:24,180 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:24,180 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:24,180 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-20 08:54:24,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:24,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:24,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:24,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:24,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:24,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:24,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:24,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:24,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:24,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:24,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:54:24,183 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-20 08:54:24,183 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-20 08:54:24,183 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:54:24,183 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:54:24,183 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:24,183 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:54:24,184 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:24,184 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:24,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:24,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:24,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:24,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:24,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:24,185 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:24,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:24,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:24,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:24,185 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:24,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:24,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:24,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:24,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:24,186 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:24,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:24,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:24,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:24,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:24,189 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:24,189 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:24,189 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:24,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:24,189 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-20 08:54:24,189 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:24,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:24,189 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:24,189 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-20 08:54:24,189 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:54:24,189 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:24,189 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:24,189 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:24,189 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:24,189 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:24,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:24,189 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-20 08:54:24,189 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:54:24,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:24,290 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:54:24,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:54:24,294 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:54:24,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-20 08:54:24,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:24,296 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-20 08:54:24,296 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:24,296 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-20 08:54:24,296 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-20 08:54:24,296 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:24,296 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:24,299 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:24,299 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:24,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:24,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:24,299 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:24,299 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:54:24,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:24,299 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:24,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:54:24,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:24,300 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:24,300 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-20 08:54:24,300 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:24,300 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-20 08:54:24,300 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:24,300 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-20 08:54:24,300 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-20 08:54:24,300 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:54:24,300 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700470456262.ebc91fbf023be453f933eaa5806158e2. 2023-11-20 08:54:24,300 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700470456262.ebc91fbf023be453f933eaa5806158e2. started... 2023-11-20 08:54:24,301 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ebc91fbf023be453f933eaa5806158e2 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-20 08:54:24,714 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103e767310f76e34a629642c1d1864780ac to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103e767310f76e34a629642c1d1864780ac 2023-11-20 08:54:25,121 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/.tmp/family1/48cabb885b874993bec5c363cfb3457d 2023-11-20 08:54:25,126 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/.tmp/family1/48cabb885b874993bec5c363cfb3457d as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/48cabb885b874993bec5c363cfb3457d 2023-11-20 08:54:25,130 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/48cabb885b874993bec5c363cfb3457d, entries=1, sequenceid=33, filesize=4.9 K 2023-11-20 08:54:25,130 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ebc91fbf023be453f933eaa5806158e2 in 829ms, sequenceid=33, compaction requested=true 2023-11-20 08:54:25,131 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ebc91fbf023be453f933eaa5806158e2: 2023-11-20 08:54:25,131 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700470456262.ebc91fbf023be453f933eaa5806158e2. 2023-11-20 08:54:25,131 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-20 08:54:25,131 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-20 08:54:25,131 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:25,131 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-20 08:54:25,131 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-20 08:54:25,135 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:25,135 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:25,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:25,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:25,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:25,136 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:25,136 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:54:25,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:25,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:25,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:25,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:25,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:25,137 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-20 08:54:25,137 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@456d5849[Count = 0] remaining members to acquire global barrier 2023-11-20 08:54:25,137 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-20 08:54:25,138 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:25,139 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:25,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:25,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:25,139 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-20 08:54:25,139 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-20 08:54:25,139 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:54:25,139 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:25,139 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:54:25,142 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-20 08:54:25,142 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:25,142 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:25,142 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-20 08:54:25,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:25,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:25,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:25,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:25,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:25,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:25,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:25,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:25,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:25,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:25,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:54:25,145 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-20 08:54:25,145 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-20 08:54:25,145 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:54:25,145 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:54:25,145 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:25,145 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:54:25,146 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:25,147 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:25,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:25,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:25,147 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:25,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:25,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:25,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:25,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:25,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:25,147 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:25,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:25,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:25,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:25,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:25,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:25,148 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:25,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:25,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:25,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:25,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:25,151 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:25,151 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:25,151 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:25,151 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:25,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:25,151 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-20 08:54:25,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:25,151 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-20 08:54:25,151 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:54:25,151 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:25,151 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:25,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:25,151 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:25,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:25,151 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:25,152 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:25,152 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:25,152 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-20 08:54:25,152 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:54:25,252 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:54:25,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:54:25,257 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:54:25,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-20 08:54:25,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:25,258 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-20 08:54:25,258 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:25,258 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-20 08:54:25,258 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-20 08:54:25,259 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:25,259 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:25,260 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:25,260 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:25,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:25,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:25,261 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:25,261 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:54:25,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:25,261 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:25,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:54:25,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:25,261 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:25,262 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-20 08:54:25,262 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:25,262 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-20 08:54:25,262 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:25,262 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-20 08:54:25,262 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-20 08:54:25,262 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:54:25,262 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700470456262.ebc91fbf023be453f933eaa5806158e2. 2023-11-20 08:54:25,262 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700470456262.ebc91fbf023be453f933eaa5806158e2. started... 2023-11-20 08:54:25,262 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ebc91fbf023be453f933eaa5806158e2 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-20 08:54:25,676 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509078f51f3a38ea74f569a56d7c0ea7b11d6 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201509078f51f3a38ea74f569a56d7c0ea7b11d6 2023-11-20 08:54:26,082 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/.tmp/family1/efd104b2b58c4f788f5cc3102b890586 2023-11-20 08:54:26,086 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/.tmp/family1/efd104b2b58c4f788f5cc3102b890586 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/efd104b2b58c4f788f5cc3102b890586 2023-11-20 08:54:26,089 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/efd104b2b58c4f788f5cc3102b890586, entries=1, sequenceid=37, filesize=4.9 K 2023-11-20 08:54:26,090 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ebc91fbf023be453f933eaa5806158e2 in 828ms, sequenceid=37, compaction requested=true 2023-11-20 08:54:26,090 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ebc91fbf023be453f933eaa5806158e2: 2023-11-20 08:54:26,090 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700470456262.ebc91fbf023be453f933eaa5806158e2. 2023-11-20 08:54:26,090 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-20 08:54:26,090 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-20 08:54:26,091 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:26,091 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-20 08:54:26,091 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-20 08:54:26,093 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:26,093 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:26,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:26,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:26,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:26,093 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:26,093 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:54:26,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:26,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:26,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:26,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:26,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:26,095 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-20 08:54:26,095 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@27a1ea90[Count = 0] remaining members to acquire global barrier 2023-11-20 08:54:26,095 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-20 08:54:26,095 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:26,096 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:26,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:26,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:26,096 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-20 08:54:26,096 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-20 08:54:26,096 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:54:26,096 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:26,096 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:54:26,098 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-20 08:54:26,098 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:26,098 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:26,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:26,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:26,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:26,098 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-20 08:54:26,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:26,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:26,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:26,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:26,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:26,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:26,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:26,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:54:26,100 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-20 08:54:26,100 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-20 08:54:26,100 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:54:26,100 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:54:26,100 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:26,100 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:54:26,102 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:26,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:26,102 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:26,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:26,102 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:26,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:26,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:26,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:26,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:26,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:26,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:26,103 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:26,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:26,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:26,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:26,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:26,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:26,104 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:26,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:26,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:26,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:26,108 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:26,108 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:26,108 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:26,108 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:26,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:26,108 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:26,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:26,108 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-20 08:54:26,108 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-20 08:54:26,108 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:54:26,108 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:26,108 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:26,108 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:26,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:26,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:26,108 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:26,108 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-20 08:54:26,108 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:54:26,108 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:26,209 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:54:26,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:54:26,213 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:54:26,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-20 08:54:26,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:26,215 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-20 08:54:26,215 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:26,215 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-20 08:54:26,215 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-20 08:54:26,215 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:26,215 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:26,216 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:26,216 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:26,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:26,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:26,217 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:26,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:26,217 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:54:26,217 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:26,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:54:26,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:26,217 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:26,218 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-20 08:54:26,218 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:26,218 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-20 08:54:26,218 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:26,218 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-20 08:54:26,218 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-20 08:54:26,218 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:54:26,218 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700470456262.ebc91fbf023be453f933eaa5806158e2. 2023-11-20 08:54:26,218 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700470456262.ebc91fbf023be453f933eaa5806158e2. started... 2023-11-20 08:54:26,218 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ebc91fbf023be453f933eaa5806158e2 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-20 08:54:26,630 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112002eee3111c864fb8bd1cc2be1524cf44 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015112002eee3111c864fb8bd1cc2be1524cf44 2023-11-20 08:54:27,035 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/.tmp/family1/a57104b710744ce08d1a2af81e07f160 2023-11-20 08:54:27,040 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/.tmp/family1/a57104b710744ce08d1a2af81e07f160 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/a57104b710744ce08d1a2af81e07f160 2023-11-20 08:54:27,044 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/a57104b710744ce08d1a2af81e07f160, entries=1, sequenceid=41, filesize=4.9 K 2023-11-20 08:54:27,045 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ebc91fbf023be453f933eaa5806158e2 in 827ms, sequenceid=41, compaction requested=true 2023-11-20 08:54:27,045 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ebc91fbf023be453f933eaa5806158e2: 2023-11-20 08:54:27,045 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700470456262.ebc91fbf023be453f933eaa5806158e2. 2023-11-20 08:54:27,045 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-20 08:54:27,045 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-20 08:54:27,045 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:27,045 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-20 08:54:27,045 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-20 08:54:27,047 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:27,047 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:27,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:27,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:27,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:27,047 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:27,048 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:54:27,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:27,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:27,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:27,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:27,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:27,049 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-20 08:54:27,049 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4708a51f[Count = 0] remaining members to acquire global barrier 2023-11-20 08:54:27,049 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-20 08:54:27,049 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:27,051 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:27,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:27,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:27,051 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-20 08:54:27,051 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-20 08:54:27,051 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:54:27,051 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:27,051 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:54:27,054 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-20 08:54:27,054 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:27,054 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:27,054 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-20 08:54:27,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:27,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:27,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:27,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:27,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:27,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:27,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:27,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:27,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:27,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:27,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:54:27,056 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-20 08:54:27,056 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-20 08:54:27,056 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:54:27,056 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:54:27,056 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:27,056 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:54:27,058 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:27,058 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:27,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:27,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:27,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:27,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:27,058 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:27,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:27,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:27,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:27,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:27,059 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:27,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:27,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:27,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:27,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:27,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:27,060 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:27,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:27,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:27,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:27,064 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:27,064 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:27,065 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:27,065 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:27,065 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:27,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:27,065 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-20 08:54:27,065 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:54:27,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:27,065 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:27,065 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:27,065 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:27,065 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:27,065 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:27,065 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-20 08:54:27,065 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:54:27,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:27,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:27,165 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:54:27,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:54:27,167 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=36169] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyPolicy 2023-11-20 08:54:27,169 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] procedure2.ProcedureExecutor(1028): Stored pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-20 08:54:27,170 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-20 08:54:27,170 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-20 08:54:27,170 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=38, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700471067170 2023-11-20 08:54:27,173 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-20 08:54:27,175 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyPolicy' and column 'family1' 2023-11-20 08:54:27,175 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-20 08:54:27,176 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] zookeeper.ReadOnlyZKClient(139): Connect 0x602be6b3 to 127.0.0.1:64635 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-20 08:54:27,181 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@660ad282, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-20 08:54:27,181 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-20 08:54:28,026 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103351f224bcb7f41fbb298ac81f90ba11d to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103351f224bcb7f41fbb298ac81f90ba11d 2023-11-20 08:54:28,027 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-20 08:54:28,040 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-20 08:54:28,041 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58430, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-20 08:54:28,047 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-20 08:54:28,048 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46050, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-20 08:54:28,057 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/8e87637f9d534cc58e5695372a0f57ee first=Optional[r3] last=Optional[r6] 2023-11-20 08:54:28,058 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1700470456262.ebc91fbf023be453f933eaa5806158e2., hostname=jenkins-hbase4.apache.org,38491,1700470412215, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/8e87637f9d534cc58e5695372a0f57ee}] 2023-11-20 08:54:28,062 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(763): Validating hfile at hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/8e87637f9d534cc58e5695372a0f57ee for inclusion in ebc91fbf023be453f933eaa5806158e2/family1 2023-11-20 08:54:28,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-20 08:54:28,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(777): Region bounds: first= last= 2023-11-20 08:54:28,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HRegion(2446): Flush status journal for ebc91fbf023be453f933eaa5806158e2: 2023-11-20 08:54:28,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/8e87637f9d534cc58e5695372a0f57ee to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionWithWeeklyPolicy__24166hu18tqc6sc09ecv7vbfala920v9g539mq9n4bkk1r6n806as62jbq82vj43/family1/8e87637f9d534cc58e5695372a0f57ee 2023-11-20 08:54:28,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionWithWeeklyPolicy__24166hu18tqc6sc09ecv7vbfala920v9g539mq9n4bkk1r6n806as62jbq82vj43/family1/8e87637f9d534cc58e5695372a0f57ee as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/cab1ce75e1fd47a897e8df07dd422c54_SeqId_44_ 2023-11-20 08:54:28,068 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(849): Loaded HFile hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionWithWeeklyPolicy__24166hu18tqc6sc09ecv7vbfala920v9g539mq9n4bkk1r6n806as62jbq82vj43/family1/8e87637f9d534cc58e5695372a0f57ee into ebc91fbf023be453f933eaa5806158e2/family1 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/cab1ce75e1fd47a897e8df07dd422c54_SeqId_44_ - updating store file list. 2023-11-20 08:54:28,072 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(882): Loaded HFile hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/cab1ce75e1fd47a897e8df07dd422c54_SeqId_44_ into ebc91fbf023be453f933eaa5806158e2/family1 2023-11-20 08:54:28,072 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(855): Successfully loaded hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionWithWeeklyPolicy__24166hu18tqc6sc09ecv7vbfala920v9g539mq9n4bkk1r6n806as62jbq82vj43/family1/8e87637f9d534cc58e5695372a0f57ee into ebc91fbf023be453f933eaa5806158e2/family1 (new location: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/cab1ce75e1fd47a897e8df07dd422c54_SeqId_44_) 2023-11-20 08:54:28,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionWithWeeklyPolicy__24166hu18tqc6sc09ecv7vbfala920v9g539mq9n4bkk1r6n806as62jbq82vj43/family1/8e87637f9d534cc58e5695372a0f57ee 2023-11-20 08:54:28,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-20 08:54:28,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-20 08:54:28,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(1912): ebc91fbf023be453f933eaa5806158e2/family1 is initiating minor compaction 2023-11-20 08:54:28,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@132bf104; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-20 08:54:28,076 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of ebc91fbf023be453f933eaa5806158e2/family1 in testMajorCompactionWithWeeklyPolicy,,1700470456262.ebc91fbf023be453f933eaa5806158e2. 2023-11-20 08:54:28,076 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/14e401ee9a3a4b4f905797045efd51ac, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/40e52f08d1c644c491516548846e141f, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/04fdf3e1c5854dbcaff0447097a565c3, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/b0c042a9bd18443599b819fb987606dc, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/33d2ed77df914e268f854ea0db7cfb4a, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/b20ecf7f724d41c4af63a358eb0d64be, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/48cabb885b874993bec5c363cfb3457d, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/efd104b2b58c4f788f5cc3102b890586, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/a57104b710744ce08d1a2af81e07f160, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/cab1ce75e1fd47a897e8df07dd422c54_SeqId_44_] into tmpdir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/.tmp, totalSize=50.0 K 2023-11-20 08:54:28,076 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting 14e401ee9a3a4b4f905797045efd51ac, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-20 08:54:28,076 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting 40e52f08d1c644c491516548846e141f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-20 08:54:28,076 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting 04fdf3e1c5854dbcaff0447097a565c3, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-20 08:54:28,076 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting b0c042a9bd18443599b819fb987606dc, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-20 08:54:28,076 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting 33d2ed77df914e268f854ea0db7cfb4a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-20 08:54:28,077 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting b20ecf7f724d41c4af63a358eb0d64be, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-20 08:54:28,077 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting 48cabb885b874993bec5c363cfb3457d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-20 08:54:28,077 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting efd104b2b58c4f788f5cc3102b890586, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-20 08:54:28,077 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting a57104b710744ce08d1a2af81e07f160, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-20 08:54:28,077 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting cab1ce75e1fd47a897e8df07dd422c54_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-20 08:54:28,078 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-20 08:54:28,078 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:54:28,080 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228a05a1bc763944fac9e47fc846956a3a8 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228a05a1bc763944fac9e47fc846956a3a8 2023-11-20 08:54:28,081 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231fca7bbed728c4afda3d9d3aafaee2143 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231fca7bbed728c4afda3d9d3aafaee2143 2023-11-20 08:54:28,082 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101892978873a064eeb8f78f4753412fd5e to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101892978873a064eeb8f78f4753412fd5e 2023-11-20 08:54:28,084 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103e767310f76e34a629642c1d1864780ac to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103e767310f76e34a629642c1d1864780ac 2023-11-20 08:54:28,084 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-11-20 08:54:28,084 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-20 08:54:28,084 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-20 08:54:28,084 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-20 08:54:28,084 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-20 08:54:28,084 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-20 08:54:28,084 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-20 08:54:28,084 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-20 08:54:28,084 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-20 08:54:28,084 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-20 08:54:28,116 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] throttle.PressureAwareThroughputController(145): ebc91fbf023be453f933eaa5806158e2#family1#compaction#48 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-20 08:54:28,937 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/.tmp/family1/53a3b892c7514d7da760c9aaa2abafb4 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/53a3b892c7514d7da760c9aaa2abafb4 2023-11-20 08:54:28,942 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in ebc91fbf023be453f933eaa5806158e2/family1 of ebc91fbf023be453f933eaa5806158e2 into 53a3b892c7514d7da760c9aaa2abafb4(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-20 08:54:28,942 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for ebc91fbf023be453f933eaa5806158e2: 2023-11-20 08:54:28,942 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1700470456262.ebc91fbf023be453f933eaa5806158e2., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1700470468076; duration=0sec 2023-11-20 08:54:28,942 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-20 08:54:28,943 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205e3bd30c1fc1d4af88f7419dd8af7f660 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205e3bd30c1fc1d4af88f7419dd8af7f660 2023-11-20 08:54:28,944 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-20 08:54:28,968 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/b166b5691b324456add5c241b8c94f72 first=Optional[r00] last=Optional[r2] 2023-11-20 08:54:28,969 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1700470456262.ebc91fbf023be453f933eaa5806158e2., hostname=jenkins-hbase4.apache.org,38491,1700470412215, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/b166b5691b324456add5c241b8c94f72}] 2023-11-20 08:54:28,971 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(763): Validating hfile at hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/b166b5691b324456add5c241b8c94f72 for inclusion in ebc91fbf023be453f933eaa5806158e2/family1 2023-11-20 08:54:28,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-20 08:54:28,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(777): Region bounds: first= last= 2023-11-20 08:54:28,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HRegion(2446): Flush status journal for ebc91fbf023be453f933eaa5806158e2: 2023-11-20 08:54:28,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/b166b5691b324456add5c241b8c94f72 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionWithWeeklyPolicy__c2q3o504d63qe3qjnvldphv3cdec0g45u6df9uvtpjivu490in5nvgki42ucagu/family1/b166b5691b324456add5c241b8c94f72 2023-11-20 08:54:28,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionWithWeeklyPolicy__c2q3o504d63qe3qjnvldphv3cdec0g45u6df9uvtpjivu490in5nvgki42ucagu/family1/b166b5691b324456add5c241b8c94f72 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/8767903ad6134e04b31520826bcbe13b_SeqId_47_ 2023-11-20 08:54:28,978 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(849): Loaded HFile hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionWithWeeklyPolicy__c2q3o504d63qe3qjnvldphv3cdec0g45u6df9uvtpjivu490in5nvgki42ucagu/family1/b166b5691b324456add5c241b8c94f72 into ebc91fbf023be453f933eaa5806158e2/family1 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/8767903ad6134e04b31520826bcbe13b_SeqId_47_ - updating store file list. 2023-11-20 08:54:28,981 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(882): Loaded HFile hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/8767903ad6134e04b31520826bcbe13b_SeqId_47_ into ebc91fbf023be453f933eaa5806158e2/family1 2023-11-20 08:54:28,981 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(855): Successfully loaded hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionWithWeeklyPolicy__c2q3o504d63qe3qjnvldphv3cdec0g45u6df9uvtpjivu490in5nvgki42ucagu/family1/b166b5691b324456add5c241b8c94f72 into ebc91fbf023be453f933eaa5806158e2/family1 (new location: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/8767903ad6134e04b31520826bcbe13b_SeqId_47_) 2023-11-20 08:54:28,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionWithWeeklyPolicy__c2q3o504d63qe3qjnvldphv3cdec0g45u6df9uvtpjivu490in5nvgki42ucagu/family1/b166b5691b324456add5c241b8c94f72 2023-11-20 08:54:28,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-20 08:54:28,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 345120 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-20 08:54:28,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(1912): ebc91fbf023be453f933eaa5806158e2/family1 is initiating minor compaction (all files) 2023-11-20 08:54:28,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@2899d98a; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-20 08:54:28,983 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of ebc91fbf023be453f933eaa5806158e2/family1 in testMajorCompactionWithWeeklyPolicy,,1700470456262.ebc91fbf023be453f933eaa5806158e2. 2023-11-20 08:54:28,983 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/fec155405d874f0e873b276213e166ff, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/53a3b892c7514d7da760c9aaa2abafb4, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/8767903ad6134e04b31520826bcbe13b_SeqId_47_] into tmpdir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/.tmp, totalSize=337.0 K 2023-11-20 08:54:28,983 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting fec155405d874f0e873b276213e166ff, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878836012 2023-11-20 08:54:28,984 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting 53a3b892c7514d7da760c9aaa2abafb4, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621236012 2023-11-20 08:54:28,984 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting 8767903ad6134e04b31520826bcbe13b_SeqId_47_, keycount=1002, bloomtype=ROW, size=165.4 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878836012 2023-11-20 08:54:28,984 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-20 08:54:28,985 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:54:28,986 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511306c27a3bc7ce1411485406d3d50f0b19f to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511306c27a3bc7ce1411485406d3d50f0b19f 2023-11-20 08:54:28,987 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201f353cb13b12b415b86a15f71b5af127a to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201f353cb13b12b415b86a15f71b5af127a 2023-11-20 08:54:28,989 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512055f851b3e388b498cae51f175d78e8baf to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512055f851b3e388b498cae51f175d78e8baf 2023-11-20 08:54:28,989 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 3 expired mob files are deleted 2023-11-20 08:54:28,989 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-20 08:54:28,989 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-20 08:54:28,989 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-20 08:54:28,989 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-20 08:54:28,990 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=38, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-20 08:54:28,992 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=38, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.8220 sec 2023-11-20 08:54:28,999 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] throttle.PressureAwareThroughputController(145): ebc91fbf023be453f933eaa5806158e2#family1#compaction#49 average throughput is 22.09 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-20 08:54:29,016 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/14e401ee9a3a4b4f905797045efd51ac, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/40e52f08d1c644c491516548846e141f, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/04fdf3e1c5854dbcaff0447097a565c3, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/b0c042a9bd18443599b819fb987606dc, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/33d2ed77df914e268f854ea0db7cfb4a, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/b20ecf7f724d41c4af63a358eb0d64be, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/48cabb885b874993bec5c363cfb3457d, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/efd104b2b58c4f788f5cc3102b890586, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/a57104b710744ce08d1a2af81e07f160, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/cab1ce75e1fd47a897e8df07dd422c54_SeqId_44_] to archive 2023-11-20 08:54:29,017 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:54:29,019 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/14e401ee9a3a4b4f905797045efd51ac to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/14e401ee9a3a4b4f905797045efd51ac 2023-11-20 08:54:29,020 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/40e52f08d1c644c491516548846e141f to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/40e52f08d1c644c491516548846e141f 2023-11-20 08:54:29,022 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/04fdf3e1c5854dbcaff0447097a565c3 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/04fdf3e1c5854dbcaff0447097a565c3 2023-11-20 08:54:29,023 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/b0c042a9bd18443599b819fb987606dc to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/b0c042a9bd18443599b819fb987606dc 2023-11-20 08:54:29,024 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/33d2ed77df914e268f854ea0db7cfb4a to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/33d2ed77df914e268f854ea0db7cfb4a 2023-11-20 08:54:29,026 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/b20ecf7f724d41c4af63a358eb0d64be to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/b20ecf7f724d41c4af63a358eb0d64be 2023-11-20 08:54:29,029 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/48cabb885b874993bec5c363cfb3457d to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/48cabb885b874993bec5c363cfb3457d 2023-11-20 08:54:29,031 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/efd104b2b58c4f788f5cc3102b890586 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/efd104b2b58c4f788f5cc3102b890586 2023-11-20 08:54:29,032 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/a57104b710744ce08d1a2af81e07f160 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/a57104b710744ce08d1a2af81e07f160 2023-11-20 08:54:29,034 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/cab1ce75e1fd47a897e8df07dd422c54_SeqId_44_ to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/cab1ce75e1fd47a897e8df07dd422c54_SeqId_44_ 2023-11-20 08:54:29,040 DEBUG [hfile_cleaner-dir-scan-pool-1] cleaner.CleanerChore(483): Couldn't delete 'hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyPolicy' yet because it isn't empty w/exception. org.apache.hadoop.fs.PathIsNotEmptyDirectoryException: ``/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyPolicy is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) ': Directory is not empty: `/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyPolicy is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:1595) at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:881) at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:878) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.delete(DistributedFileSystem.java:878) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$null$4(CleanerChore.java:453) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.deleteAction(CleanerChore.java:478) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:453) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750) at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:455) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750) at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:455) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture.uniWhenCompleteStage(CompletableFuture.java:792) at java.util.concurrent.CompletableFuture.whenComplete(CompletableFuture.java:2153) at org.apache.hadoop.hbase.util.FutureUtils.addListener(FutureUtils.java:61) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.traverseAndDelete(CleanerChore.java:439) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$null$2(CleanerChore.java:432) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.fs.PathIsNotEmptyDirectoryException): `/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyPolicy is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.delete(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.delete(ClientNamenodeProtocolTranslatorPB.java:572) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:1593) ... 29 more 2023-11-20 08:54:29,098 INFO [Listener at localhost/43513] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=259 (was 261), OpenFileDescriptor=640 (was 665), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=160 (was 189), ProcessCount=168 (was 170), AvailableMemoryMB=14769 (was 14816) 2023-11-20 08:54:29,112 INFO [Listener at localhost/43513] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=259, OpenFileDescriptor=640, MaxFileDescriptor=60000, SystemLoadAverage=160, ProcessCount=168, AvailableMemoryMB=14769 2023-11-20 08:54:29,113 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-20 08:54:29,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure2.ProcedureExecutor(1028): Stored pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:29,115 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_PRE_OPERATION 2023-11-20 08:54:29,116 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly" procId is: 39 2023-11-20 08:54:29,116 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-20 08:54:29,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-20 08:54:29,117 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240 2023-11-20 08:54:29,118 DEBUG [HFileArchiver-9] backup.HFileArchiver(153): Directory hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240 empty. 2023-11-20 08:54:29,118 DEBUG [HFileArchiver-9] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240 2023-11-20 08:54:29,119 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly regions 2023-11-20 08:54:29,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-20 08:54:29,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-20 08:54:29,529 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-11-20 08:54:29,530 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(7675): creating {ENCODED => 559bfeb2e96b535ce0a8d89357bdb240, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp 2023-11-20 08:54:29,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-20 08:54:29,936 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-20 08:54:29,936 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1604): Closing 559bfeb2e96b535ce0a8d89357bdb240, disabling compactions & flushes 2023-11-20 08:54:29,936 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240. 2023-11-20 08:54:29,936 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240. 2023-11-20 08:54:29,936 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240. after waiting 0 ms 2023-11-20 08:54:29,936 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240. 2023-11-20 08:54:29,936 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240. 2023-11-20 08:54:29,936 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1558): Region close journal for 559bfeb2e96b535ce0a8d89357bdb240: 2023-11-20 08:54:29,938 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ADD_TO_META 2023-11-20 08:54:29,939 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700470469939"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700470469939"}]},"ts":"1700470469939"} 2023-11-20 08:54:29,941 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-20 08:54:29,941 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-20 08:54:29,941 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700470469941"}]},"ts":"1700470469941"} 2023-11-20 08:54:29,942 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLING in hbase:meta 2023-11-20 08:54:29,945 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=559bfeb2e96b535ce0a8d89357bdb240, ASSIGN}] 2023-11-20 08:54:29,947 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=559bfeb2e96b535ce0a8d89357bdb240, ASSIGN 2023-11-20 08:54:29,947 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=559bfeb2e96b535ce0a8d89357bdb240, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38491,1700470412215; forceNewPlan=false, retain=false 2023-11-20 08:54:30,098 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=559bfeb2e96b535ce0a8d89357bdb240, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:30,099 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700470470098"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700470470098"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700470470098"}]},"ts":"1700470470098"} 2023-11-20 08:54:30,100 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=41, ppid=40, state=RUNNABLE; OpenRegionProcedure 559bfeb2e96b535ce0a8d89357bdb240, server=jenkins-hbase4.apache.org,38491,1700470412215}] 2023-11-20 08:54:30,217 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/.tmp/family1/9be74084ff824ec78f1f24c817f975d1 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/9be74084ff824ec78f1f24c817f975d1 2023-11-20 08:54:30,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-20 08:54:30,222 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in ebc91fbf023be453f933eaa5806158e2/family1 of ebc91fbf023be453f933eaa5806158e2 into 9be74084ff824ec78f1f24c817f975d1(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-20 08:54:30,222 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for ebc91fbf023be453f933eaa5806158e2: 2023-11-20 08:54:30,222 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1700470456262.ebc91fbf023be453f933eaa5806158e2., storeName=family1, fileCount=3, fileSize=337.0 K (165.1 K, 6.6 K, 165.4 K), priority=2, time=1700470468983; duration=1sec 2023-11-20 08:54:30,222 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-20 08:54:30,252 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:30,254 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240. 2023-11-20 08:54:30,254 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 559bfeb2e96b535ce0a8d89357bdb240, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240.', STARTKEY => '', ENDKEY => ''} 2023-11-20 08:54:30,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 559bfeb2e96b535ce0a8d89357bdb240 2023-11-20 08:54:30,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-20 08:54:30,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 559bfeb2e96b535ce0a8d89357bdb240 2023-11-20 08:54:30,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 559bfeb2e96b535ce0a8d89357bdb240 2023-11-20 08:54:30,256 INFO [StoreOpener-559bfeb2e96b535ce0a8d89357bdb240-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 559bfeb2e96b535ce0a8d89357bdb240 2023-11-20 08:54:30,257 DEBUG [StoreOpener-559bfeb2e96b535ce0a8d89357bdb240-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1 2023-11-20 08:54:30,257 DEBUG [StoreOpener-559bfeb2e96b535ce0a8d89357bdb240-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1 2023-11-20 08:54:30,257 INFO [StoreOpener-559bfeb2e96b535ce0a8d89357bdb240-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 559bfeb2e96b535ce0a8d89357bdb240 columnFamilyName family1 2023-11-20 08:54:30,259 INFO [StoreOpener-559bfeb2e96b535ce0a8d89357bdb240-1] regionserver.HStore(310): Store=559bfeb2e96b535ce0a8d89357bdb240/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-20 08:54:30,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240 2023-11-20 08:54:30,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240 2023-11-20 08:54:30,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 559bfeb2e96b535ce0a8d89357bdb240 2023-11-20 08:54:30,263 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-20 08:54:30,264 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 559bfeb2e96b535ce0a8d89357bdb240; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61931786, jitterRate=-0.07714447379112244}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-20 08:54:30,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 559bfeb2e96b535ce0a8d89357bdb240: 2023-11-20 08:54:30,264 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240., pid=41, masterSystemTime=1700470470252 2023-11-20 08:54:30,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240. 2023-11-20 08:54:30,266 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240. 2023-11-20 08:54:30,266 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=559bfeb2e96b535ce0a8d89357bdb240, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:30,266 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700470470266"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700470470266"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700470470266"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700470470266"}]},"ts":"1700470470266"} 2023-11-20 08:54:30,269 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=41, resume processing ppid=40 2023-11-20 08:54:30,269 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=41, ppid=40, state=SUCCESS; OpenRegionProcedure 559bfeb2e96b535ce0a8d89357bdb240, server=jenkins-hbase4.apache.org,38491,1700470412215 in 168 msec 2023-11-20 08:54:30,271 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=39 2023-11-20 08:54:30,271 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=559bfeb2e96b535ce0a8d89357bdb240, ASSIGN in 324 msec 2023-11-20 08:54:30,272 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-20 08:54:30,272 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700470470272"}]},"ts":"1700470470272"} 2023-11-20 08:54:30,273 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLED in hbase:meta 2023-11-20 08:54:30,275 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_POST_OPERATION 2023-11-20 08:54:30,276 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=39, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.1620 sec 2023-11-20 08:54:30,305 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/fec155405d874f0e873b276213e166ff, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/53a3b892c7514d7da760c9aaa2abafb4, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/8767903ad6134e04b31520826bcbe13b_SeqId_47_] to archive 2023-11-20 08:54:30,305 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:54:30,307 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/fec155405d874f0e873b276213e166ff to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/fec155405d874f0e873b276213e166ff 2023-11-20 08:54:30,308 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/53a3b892c7514d7da760c9aaa2abafb4 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/53a3b892c7514d7da760c9aaa2abafb4 2023-11-20 08:54:30,309 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/8767903ad6134e04b31520826bcbe13b_SeqId_47_ to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/family1/8767903ad6134e04b31520826bcbe13b_SeqId_47_ 2023-11-20 08:54:31,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-20 08:54:31,221 INFO [Listener at localhost/43513] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, procId: 39 completed 2023-11-20 08:54:31,242 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:54:31,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:31,244 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-20 08:54:31,244 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:31,244 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-20 08:54:31,244 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-20 08:54:31,244 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:31,244 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:31,246 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:31,246 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:31,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:31,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:31,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:31,247 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:31,247 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:54:31,247 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:31,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:54:31,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:31,247 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:31,248 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:31,248 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-20 08:54:31,248 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:31,248 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-20 08:54:31,248 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-20 08:54:31,248 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:54:31,248 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240. 2023-11-20 08:54:31,248 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240. started... 2023-11-20 08:54:31,249 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 559bfeb2e96b535ce0a8d89357bdb240 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-20 08:54:31,667 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130592496d318244f0587fbf138680d9817 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130592496d318244f0587fbf138680d9817 2023-11-20 08:54:32,071 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/.tmp/family1/a39f50e6439b485ca56d2009e22527c1 2023-11-20 08:54:32,076 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/.tmp/family1/a39f50e6439b485ca56d2009e22527c1 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/a39f50e6439b485ca56d2009e22527c1 2023-11-20 08:54:32,080 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/a39f50e6439b485ca56d2009e22527c1, entries=1000, sequenceid=5, filesize=191.4 K 2023-11-20 08:54:32,081 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 559bfeb2e96b535ce0a8d89357bdb240 in 832ms, sequenceid=5, compaction requested=false 2023-11-20 08:54:32,081 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-20 08:54:32,081 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 559bfeb2e96b535ce0a8d89357bdb240: 2023-11-20 08:54:32,081 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240. 2023-11-20 08:54:32,081 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-20 08:54:32,081 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-20 08:54:32,081 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:32,081 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-20 08:54:32,081 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-20 08:54:32,083 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:32,083 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:32,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:32,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:32,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:32,083 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:32,083 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:54:32,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:32,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:32,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:32,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:32,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:32,085 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-20 08:54:32,085 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4ff9b172[Count = 0] remaining members to acquire global barrier 2023-11-20 08:54:32,085 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-20 08:54:32,085 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:32,086 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:32,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:32,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:32,086 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-20 08:54:32,086 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-20 08:54:32,086 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:54:32,086 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:32,087 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:54:32,088 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:32,088 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-20 08:54:32,088 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:32,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:32,088 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-20 08:54:32,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:32,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:32,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:32,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:32,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:32,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:32,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:32,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:32,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:32,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:54:32,090 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-20 08:54:32,090 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-20 08:54:32,090 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:54:32,090 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:54:32,090 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:32,091 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:54:32,093 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:32,093 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:32,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:32,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:32,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:32,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:32,093 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:32,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:32,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:32,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:32,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:32,093 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:32,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:32,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:32,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:32,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:32,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:32,095 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:32,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:32,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:32,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:32,097 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:32,097 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:32,097 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:32,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:32,097 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:32,097 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:32,097 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-20 08:54:32,098 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:54:32,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:32,097 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:32,098 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:32,098 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:32,098 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:32,098 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:32,098 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-20 08:54:32,098 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:54:32,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:32,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:32,198 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:54:32,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:54:32,203 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:54:32,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-20 08:54:32,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:32,204 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-20 08:54:32,204 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:32,204 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-20 08:54:32,204 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-20 08:54:32,205 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:32,205 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:32,206 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:32,206 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:32,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:32,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:32,207 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:32,207 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:54:32,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:32,207 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:32,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:54:32,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:32,208 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:32,208 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-20 08:54:32,208 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:32,208 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-20 08:54:32,208 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:32,208 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-20 08:54:32,208 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-20 08:54:32,208 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:54:32,208 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240. 2023-11-20 08:54:32,208 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240. started... 2023-11-20 08:54:32,208 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 559bfeb2e96b535ce0a8d89357bdb240 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-20 08:54:32,624 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112819bf5332d1ce4a8b8c108a47881ddafb to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112819bf5332d1ce4a8b8c108a47881ddafb 2023-11-20 08:54:33,030 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/.tmp/family1/a018c0359c7c44d5b27ac9cfbb4caf15 2023-11-20 08:54:33,034 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/.tmp/family1/a018c0359c7c44d5b27ac9cfbb4caf15 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/a018c0359c7c44d5b27ac9cfbb4caf15 2023-11-20 08:54:33,039 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/a018c0359c7c44d5b27ac9cfbb4caf15, entries=1, sequenceid=9, filesize=5.0 K 2023-11-20 08:54:33,040 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 559bfeb2e96b535ce0a8d89357bdb240 in 832ms, sequenceid=9, compaction requested=false 2023-11-20 08:54:33,040 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 559bfeb2e96b535ce0a8d89357bdb240: 2023-11-20 08:54:33,040 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240. 2023-11-20 08:54:33,040 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-20 08:54:33,040 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-20 08:54:33,040 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:33,040 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-20 08:54:33,040 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-20 08:54:33,042 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:33,042 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:33,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:33,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:33,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:33,042 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:33,043 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:54:33,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:33,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:33,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:33,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:33,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:33,044 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-20 08:54:33,044 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@607917d4[Count = 0] remaining members to acquire global barrier 2023-11-20 08:54:33,044 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-20 08:54:33,044 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:33,046 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:33,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:33,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:33,046 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-20 08:54:33,047 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-20 08:54:33,047 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:54:33,047 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:33,047 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:54:33,048 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-20 08:54:33,048 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:33,048 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:33,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:33,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:33,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:33,048 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-20 08:54:33,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:33,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:33,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:33,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:33,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:33,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:33,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:33,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:54:33,051 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-20 08:54:33,051 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-20 08:54:33,051 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:54:33,051 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:54:33,051 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:33,051 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:54:33,053 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:33,053 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:33,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:33,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:33,053 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:33,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:33,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:33,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:33,054 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:33,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:33,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:33,054 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:33,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:33,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:33,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:33,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:33,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:33,055 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:33,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:33,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:33,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:33,062 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:33,062 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:33,062 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:33,062 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:33,062 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:33,062 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:33,062 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-20 08:54:33,062 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:54:33,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:33,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:33,062 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:33,062 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:33,062 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-20 08:54:33,063 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:54:33,062 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:33,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:33,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:33,063 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:33,163 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:54:33,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:54:33,167 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:54:33,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-20 08:54:33,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:33,169 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-20 08:54:33,169 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:33,169 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-20 08:54:33,169 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-20 08:54:33,170 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:33,170 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:33,172 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:33,172 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:33,172 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:33,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:33,172 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:33,172 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:54:33,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:33,172 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:33,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:54:33,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:33,173 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:33,173 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-20 08:54:33,173 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:33,173 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-20 08:54:33,173 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:33,173 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-20 08:54:33,173 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-20 08:54:33,173 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:54:33,174 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240. 2023-11-20 08:54:33,174 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240. started... 2023-11-20 08:54:33,174 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 559bfeb2e96b535ce0a8d89357bdb240 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-20 08:54:33,586 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201e930c2dec37e43b9a333c29238475714 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201e930c2dec37e43b9a333c29238475714 2023-11-20 08:54:33,592 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/.tmp/family1/f4c572c22323463e9638e2b3b91aca64 2023-11-20 08:54:33,596 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/.tmp/family1/f4c572c22323463e9638e2b3b91aca64 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/f4c572c22323463e9638e2b3b91aca64 2023-11-20 08:54:33,600 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/f4c572c22323463e9638e2b3b91aca64, entries=1, sequenceid=13, filesize=5.0 K 2023-11-20 08:54:33,601 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 559bfeb2e96b535ce0a8d89357bdb240 in 427ms, sequenceid=13, compaction requested=true 2023-11-20 08:54:33,601 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 559bfeb2e96b535ce0a8d89357bdb240: 2023-11-20 08:54:33,601 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240. 2023-11-20 08:54:33,601 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-20 08:54:33,601 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-20 08:54:33,601 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:33,601 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-20 08:54:33,601 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-20 08:54:33,603 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:33,603 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:33,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:33,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:33,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:33,603 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:33,603 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:54:33,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:33,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:33,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:33,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:33,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:33,605 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-20 08:54:33,605 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@48a49421[Count = 0] remaining members to acquire global barrier 2023-11-20 08:54:33,605 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-20 08:54:33,605 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:33,607 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:33,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:33,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:33,607 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-20 08:54:33,607 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-20 08:54:33,607 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:54:33,608 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:33,608 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:54:33,609 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:33,609 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-20 08:54:33,609 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:33,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:33,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:33,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:33,609 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-20 08:54:33,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:33,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:33,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:33,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:33,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:33,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:33,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:33,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:54:33,612 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-20 08:54:33,612 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-20 08:54:33,612 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:54:33,612 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:54:33,612 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:33,612 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:54:33,613 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:33,613 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:33,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:33,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:33,613 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:33,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:33,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:33,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:33,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:33,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:33,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:33,614 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:33,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:33,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:33,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:33,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:33,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:33,615 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:33,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:33,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:33,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:33,617 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:33,617 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:33,617 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:33,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:33,618 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-20 08:54:33,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:33,618 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:54:33,618 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:33,618 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:33,618 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:33,618 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:33,618 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:33,618 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-20 08:54:33,617 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:33,618 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:54:33,618 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:33,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:33,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:33,718 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:54:33,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:54:33,722 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:54:33,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-20 08:54:33,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:33,724 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-20 08:54:33,724 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:33,724 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-20 08:54:33,724 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-20 08:54:33,725 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:33,725 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:33,727 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:33,727 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:33,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:33,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:33,727 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:33,727 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:54:33,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:33,727 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:33,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:54:33,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:33,728 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:33,728 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-20 08:54:33,728 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:33,728 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-20 08:54:33,728 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:33,728 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-20 08:54:33,728 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-20 08:54:33,728 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:54:33,728 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240. 2023-11-20 08:54:33,728 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240. started... 2023-11-20 08:54:33,729 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 559bfeb2e96b535ce0a8d89357bdb240 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-20 08:54:34,141 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512050e900cf45e09415291d723c5d98e1249 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512050e900cf45e09415291d723c5d98e1249 2023-11-20 08:54:34,546 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/.tmp/family1/ebfc135aca444cb28423fd11779384f1 2023-11-20 08:54:34,551 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/.tmp/family1/ebfc135aca444cb28423fd11779384f1 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/ebfc135aca444cb28423fd11779384f1 2023-11-20 08:54:34,555 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/ebfc135aca444cb28423fd11779384f1, entries=1, sequenceid=17, filesize=5.0 K 2023-11-20 08:54:34,556 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 559bfeb2e96b535ce0a8d89357bdb240 in 827ms, sequenceid=17, compaction requested=true 2023-11-20 08:54:34,556 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 559bfeb2e96b535ce0a8d89357bdb240: 2023-11-20 08:54:34,556 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240. 2023-11-20 08:54:34,556 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-20 08:54:34,556 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-20 08:54:34,556 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:34,556 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-20 08:54:34,556 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-20 08:54:34,559 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:34,559 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:34,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:34,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:34,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:34,559 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:34,559 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:54:34,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:34,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:34,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:34,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:34,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:34,561 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-20 08:54:34,561 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4a06f077[Count = 0] remaining members to acquire global barrier 2023-11-20 08:54:34,561 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-20 08:54:34,561 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:34,562 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:34,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:34,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:34,562 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-20 08:54:34,562 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-20 08:54:34,562 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:54:34,562 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:34,563 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:54:34,564 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-20 08:54:34,564 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:34,564 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:34,564 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-20 08:54:34,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:34,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:34,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:34,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:34,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:34,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:34,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:34,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:34,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:34,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:34,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:54:34,567 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-20 08:54:34,567 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-20 08:54:34,567 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:54:34,567 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:54:34,567 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:34,567 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:54:34,569 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:34,569 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:34,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:34,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:34,569 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:34,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:34,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:34,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:34,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:34,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:34,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:34,569 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:34,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:34,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:34,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:34,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:34,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:34,571 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:34,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:34,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:34,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:34,574 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:34,574 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:34,574 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:34,574 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:34,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:34,575 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-20 08:54:34,575 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:54:34,574 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:34,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:34,575 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:34,575 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:34,575 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:34,575 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-20 08:54:34,575 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:54:34,575 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:34,575 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:34,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:34,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:34,675 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:54:34,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:54:34,680 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:54:34,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-20 08:54:34,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:34,681 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-20 08:54:34,682 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:34,682 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-20 08:54:34,682 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-20 08:54:34,682 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:34,682 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:34,684 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:34,684 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:34,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:34,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:34,684 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:34,684 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:54:34,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:34,684 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:34,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:54:34,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:34,685 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:34,685 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-20 08:54:34,685 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:34,685 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-20 08:54:34,685 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:34,685 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-20 08:54:34,685 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-20 08:54:34,685 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:54:34,685 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240. 2023-11-20 08:54:34,685 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240. started... 2023-11-20 08:54:34,686 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 559bfeb2e96b535ce0a8d89357bdb240 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-20 08:54:35,097 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122877aab8b912aa407587c7beff2528a9bd to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015122877aab8b912aa407587c7beff2528a9bd 2023-11-20 08:54:35,503 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/.tmp/family1/1ea8917de4db4c9b80f39e61575e1367 2023-11-20 08:54:35,507 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/.tmp/family1/1ea8917de4db4c9b80f39e61575e1367 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/1ea8917de4db4c9b80f39e61575e1367 2023-11-20 08:54:35,512 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/1ea8917de4db4c9b80f39e61575e1367, entries=1, sequenceid=21, filesize=5.0 K 2023-11-20 08:54:35,513 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 559bfeb2e96b535ce0a8d89357bdb240 in 827ms, sequenceid=21, compaction requested=true 2023-11-20 08:54:35,513 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 559bfeb2e96b535ce0a8d89357bdb240: 2023-11-20 08:54:35,513 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240. 2023-11-20 08:54:35,513 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-20 08:54:35,513 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-20 08:54:35,513 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:35,513 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-20 08:54:35,513 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-20 08:54:35,515 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:35,515 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:35,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:35,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:35,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:35,516 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:35,516 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:54:35,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:35,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:35,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:35,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:35,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:35,517 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-20 08:54:35,517 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4876aa64[Count = 0] remaining members to acquire global barrier 2023-11-20 08:54:35,517 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-20 08:54:35,517 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:35,519 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:35,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:35,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:35,519 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-20 08:54:35,519 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-20 08:54:35,519 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:54:35,519 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:35,519 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:54:35,520 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-20 08:54:35,520 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:35,520 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:35,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:35,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:35,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:35,520 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-20 08:54:35,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:35,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:35,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:35,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:35,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:35,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:35,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:35,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:54:35,523 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-20 08:54:35,523 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-20 08:54:35,523 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:54:35,523 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:54:35,523 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:35,523 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:54:35,526 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:35,526 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:35,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:35,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:35,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:35,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:35,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:35,526 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:35,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:35,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:35,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:35,527 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:35,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:35,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:35,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:35,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:35,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:35,528 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:35,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:35,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:35,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:35,530 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:35,530 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:35,530 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:35,531 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:35,531 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-20 08:54:35,531 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-20 08:54:35,531 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:54:35,531 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:35,531 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:35,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:35,531 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:35,531 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:35,531 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:35,531 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-20 08:54:35,531 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:35,531 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:54:35,531 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:35,531 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:35,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:35,631 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:54:35,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:54:35,636 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:54:35,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-20 08:54:35,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:35,637 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-20 08:54:35,637 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:35,637 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-20 08:54:35,637 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-20 08:54:35,638 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:35,638 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:35,639 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:35,639 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:35,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:35,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:35,640 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:35,640 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:54:35,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:35,640 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:35,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:54:35,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:35,641 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:35,641 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-20 08:54:35,641 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:35,641 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-20 08:54:35,641 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:35,641 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-20 08:54:35,641 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-20 08:54:35,641 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:54:35,641 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240. 2023-11-20 08:54:35,641 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240. started... 2023-11-20 08:54:35,641 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 559bfeb2e96b535ce0a8d89357bdb240 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-20 08:54:35,784 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-20 08:54:36,054 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231020ef030b77c43378951c7fdcb15d185 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231020ef030b77c43378951c7fdcb15d185 2023-11-20 08:54:36,460 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/.tmp/family1/8698844ea59b4690868c6a026499c702 2023-11-20 08:54:36,464 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/.tmp/family1/8698844ea59b4690868c6a026499c702 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/8698844ea59b4690868c6a026499c702 2023-11-20 08:54:36,468 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/8698844ea59b4690868c6a026499c702, entries=1, sequenceid=25, filesize=5.0 K 2023-11-20 08:54:36,469 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 559bfeb2e96b535ce0a8d89357bdb240 in 828ms, sequenceid=25, compaction requested=true 2023-11-20 08:54:36,469 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 559bfeb2e96b535ce0a8d89357bdb240: 2023-11-20 08:54:36,469 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240. 2023-11-20 08:54:36,469 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-20 08:54:36,469 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-20 08:54:36,469 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:36,469 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-20 08:54:36,469 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-20 08:54:36,471 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:36,471 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:36,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:36,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:36,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:36,471 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:36,471 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:54:36,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:36,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:36,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:36,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:36,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:36,473 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-20 08:54:36,473 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6099d309[Count = 0] remaining members to acquire global barrier 2023-11-20 08:54:36,473 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-20 08:54:36,473 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:36,476 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:36,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:36,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:36,476 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-20 08:54:36,476 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-20 08:54:36,476 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:54:36,476 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:36,476 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:54:36,478 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:36,478 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-20 08:54:36,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:36,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:36,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:36,478 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:36,478 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-20 08:54:36,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:36,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:36,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:36,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:36,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:36,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:36,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:36,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:54:36,480 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-20 08:54:36,480 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-20 08:54:36,480 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:54:36,480 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:54:36,480 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:36,480 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:54:36,482 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:36,482 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:36,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:36,482 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:36,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:36,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:36,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:36,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:36,482 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:36,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:36,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:36,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:36,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:36,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:36,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:36,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:36,484 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:36,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:36,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:36,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:36,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:36,486 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:36,486 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:36,486 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:36,486 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:36,486 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:36,486 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:36,486 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-20 08:54:36,486 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:54:36,486 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-20 08:54:36,486 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:36,486 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:36,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:36,486 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:36,487 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-20 08:54:36,487 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:36,487 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:54:36,487 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:36,487 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:36,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:36,587 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:54:36,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:54:36,591 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:54:36,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-20 08:54:36,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:36,593 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-20 08:54:36,593 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:36,593 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-20 08:54:36,593 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-20 08:54:36,593 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:36,593 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:36,599 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:36,599 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:36,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:36,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:36,599 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:36,599 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:54:36,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:36,600 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:36,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:54:36,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:36,600 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:36,600 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-20 08:54:36,600 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:36,600 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-20 08:54:36,600 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:36,600 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-20 08:54:36,601 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-20 08:54:36,601 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:54:36,601 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240. 2023-11-20 08:54:36,601 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240. started... 2023-11-20 08:54:36,601 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 559bfeb2e96b535ce0a8d89357bdb240 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-20 08:54:37,013 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101932e799a0ded4b8db476f540145d698c to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101932e799a0ded4b8db476f540145d698c 2023-11-20 08:54:37,418 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/.tmp/family1/56a7f27b99064e59afd20b552dee31bb 2023-11-20 08:54:37,423 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/.tmp/family1/56a7f27b99064e59afd20b552dee31bb as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/56a7f27b99064e59afd20b552dee31bb 2023-11-20 08:54:37,427 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/56a7f27b99064e59afd20b552dee31bb, entries=1, sequenceid=29, filesize=5.0 K 2023-11-20 08:54:37,427 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 559bfeb2e96b535ce0a8d89357bdb240 in 826ms, sequenceid=29, compaction requested=true 2023-11-20 08:54:37,428 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 559bfeb2e96b535ce0a8d89357bdb240: 2023-11-20 08:54:37,428 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240. 2023-11-20 08:54:37,428 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-20 08:54:37,428 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-20 08:54:37,428 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:37,428 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-20 08:54:37,428 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-20 08:54:37,429 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:37,429 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:37,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:37,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:37,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:37,430 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:37,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:37,430 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:54:37,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:37,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:37,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:37,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:37,431 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-20 08:54:37,431 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@c7046a7[Count = 0] remaining members to acquire global barrier 2023-11-20 08:54:37,431 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-20 08:54:37,431 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:37,432 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:37,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:37,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:37,432 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-20 08:54:37,432 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-20 08:54:37,433 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:54:37,433 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:37,433 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:54:37,437 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:37,437 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-20 08:54:37,437 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:37,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:37,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:37,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:37,437 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-20 08:54:37,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:37,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:37,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:37,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:37,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:37,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:37,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:37,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:54:37,439 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-20 08:54:37,439 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-20 08:54:37,439 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:54:37,440 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:54:37,440 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:37,440 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:54:37,441 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:37,441 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:37,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:37,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:37,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:37,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:37,441 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:37,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:37,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:37,442 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:37,442 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:37,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:37,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:37,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:37,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:37,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:37,443 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:37,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:37,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:37,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:37,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:37,445 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:37,445 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:37,445 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:37,445 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:37,445 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:37,445 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:37,445 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:37,445 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-20 08:54:37,445 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-20 08:54:37,445 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:54:37,445 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:37,445 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:37,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:37,446 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:37,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:37,446 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-20 08:54:37,446 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:54:37,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:37,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:37,546 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:54:37,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:54:37,550 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:54:37,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-20 08:54:37,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:37,552 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-20 08:54:37,552 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:37,552 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-20 08:54:37,552 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-20 08:54:37,552 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:37,552 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:37,554 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:37,554 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:37,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:37,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:37,554 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:37,554 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:54:37,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:37,555 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:37,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:54:37,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:37,555 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:37,555 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-20 08:54:37,555 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:37,555 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-20 08:54:37,555 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:37,555 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-20 08:54:37,556 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-20 08:54:37,556 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:54:37,556 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240. 2023-11-20 08:54:37,556 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240. started... 2023-11-20 08:54:37,556 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 559bfeb2e96b535ce0a8d89357bdb240 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-20 08:54:37,967 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601034d012d0844414971b9347e4b946a9d48 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601034d012d0844414971b9347e4b946a9d48 2023-11-20 08:54:38,373 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/.tmp/family1/9ef458e8b3d34093a42cc80f4006f546 2023-11-20 08:54:38,378 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/.tmp/family1/9ef458e8b3d34093a42cc80f4006f546 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/9ef458e8b3d34093a42cc80f4006f546 2023-11-20 08:54:38,381 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/9ef458e8b3d34093a42cc80f4006f546, entries=1, sequenceid=33, filesize=5.0 K 2023-11-20 08:54:38,382 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 559bfeb2e96b535ce0a8d89357bdb240 in 826ms, sequenceid=33, compaction requested=true 2023-11-20 08:54:38,382 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 559bfeb2e96b535ce0a8d89357bdb240: 2023-11-20 08:54:38,382 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240. 2023-11-20 08:54:38,382 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-20 08:54:38,382 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-20 08:54:38,382 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:38,382 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-20 08:54:38,382 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-20 08:54:38,385 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:38,385 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:38,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:38,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:38,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:38,385 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:38,386 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:54:38,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:38,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:38,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:38,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:38,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:38,387 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-20 08:54:38,387 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@71889a16[Count = 0] remaining members to acquire global barrier 2023-11-20 08:54:38,387 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-20 08:54:38,387 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:38,389 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:38,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:38,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:38,389 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-20 08:54:38,389 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-20 08:54:38,389 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:54:38,389 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:38,389 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:54:38,391 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-20 08:54:38,391 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:38,391 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:38,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:38,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:38,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:38,391 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-20 08:54:38,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:38,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:38,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:38,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:38,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:38,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:38,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:38,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:54:38,393 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-20 08:54:38,393 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-20 08:54:38,393 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:54:38,393 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:54:38,393 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:38,393 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:54:38,395 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:38,395 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:38,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:38,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:38,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:38,395 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:38,395 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:38,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:38,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:38,396 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:38,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:38,396 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:38,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:38,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:38,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:38,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:38,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:38,397 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:38,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:38,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:38,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:38,404 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:38,404 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:38,404 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:38,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:38,404 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:38,404 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-20 08:54:38,404 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:54:38,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:38,404 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:38,404 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:38,404 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:38,404 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:38,404 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:38,404 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-20 08:54:38,404 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:54:38,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:38,404 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:38,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:38,504 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:54:38,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:54:38,508 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:54:38,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-20 08:54:38,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:38,510 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-20 08:54:38,510 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:38,510 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-20 08:54:38,510 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-20 08:54:38,511 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:38,511 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:38,512 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:38,512 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:38,512 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:38,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:38,513 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:38,513 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:54:38,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:38,513 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:38,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:54:38,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:38,514 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:38,514 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-20 08:54:38,514 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:38,514 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-20 08:54:38,514 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:38,514 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-20 08:54:38,514 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-20 08:54:38,514 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:54:38,514 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240. 2023-11-20 08:54:38,514 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240. started... 2023-11-20 08:54:38,514 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 559bfeb2e96b535ce0a8d89357bdb240 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-20 08:54:38,927 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907ee1154c57c114d0d85c2e1ba51af7ded to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20150907ee1154c57c114d0d85c2e1ba51af7ded 2023-11-20 08:54:39,333 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/.tmp/family1/ddab588e54f74ca8b8a55d7cc4181f1e 2023-11-20 08:54:39,337 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/.tmp/family1/ddab588e54f74ca8b8a55d7cc4181f1e as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/ddab588e54f74ca8b8a55d7cc4181f1e 2023-11-20 08:54:39,341 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/ddab588e54f74ca8b8a55d7cc4181f1e, entries=1, sequenceid=37, filesize=5.0 K 2023-11-20 08:54:39,342 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 559bfeb2e96b535ce0a8d89357bdb240 in 828ms, sequenceid=37, compaction requested=true 2023-11-20 08:54:39,342 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 559bfeb2e96b535ce0a8d89357bdb240: 2023-11-20 08:54:39,342 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240. 2023-11-20 08:54:39,342 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-20 08:54:39,342 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-20 08:54:39,342 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:39,342 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-20 08:54:39,342 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-20 08:54:39,344 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:39,344 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:39,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:39,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:39,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:39,344 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:39,344 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:54:39,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:39,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:39,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:39,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:39,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:39,345 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-20 08:54:39,345 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@c502bc9[Count = 0] remaining members to acquire global barrier 2023-11-20 08:54:39,345 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-20 08:54:39,346 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:39,347 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:39,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:39,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:39,347 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-20 08:54:39,347 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:39,347 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:54:39,347 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-20 08:54:39,347 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:54:39,349 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-20 08:54:39,349 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:39,349 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:39,349 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-20 08:54:39,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:39,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:39,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:39,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:39,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:39,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:39,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:39,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:39,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:39,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:39,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:54:39,351 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-20 08:54:39,351 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-20 08:54:39,351 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:54:39,351 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:54:39,351 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:39,351 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:54:39,353 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:39,353 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:39,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:39,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:39,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:39,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:39,353 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:39,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:39,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:39,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:39,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:39,354 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:39,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:39,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:39,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:39,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:39,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:39,355 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:39,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:39,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:39,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:39,360 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:39,360 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:39,360 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:39,360 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:39,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:39,360 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-20 08:54:39,360 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:54:39,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:39,360 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:39,360 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:39,360 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:39,360 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:39,360 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-20 08:54:39,360 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:54:39,360 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:39,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:39,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:39,360 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:39,460 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:54:39,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:54:39,465 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:54:39,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-20 08:54:39,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:39,467 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-20 08:54:39,467 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:39,467 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-20 08:54:39,467 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-20 08:54:39,467 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:39,467 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:39,470 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:39,470 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:39,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:39,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:39,471 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:39,471 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:54:39,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:39,471 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:39,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:54:39,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:39,471 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:39,472 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-20 08:54:39,472 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:39,472 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-20 08:54:39,472 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:39,472 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-20 08:54:39,472 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-20 08:54:39,472 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:54:39,472 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240. 2023-11-20 08:54:39,472 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240. started... 2023-11-20 08:54:39,472 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 559bfeb2e96b535ce0a8d89357bdb240 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-20 08:54:39,884 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511207c2fa93245be4fafa4298cb62856626d to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511207c2fa93245be4fafa4298cb62856626d 2023-11-20 08:54:40,290 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/.tmp/family1/c33c9a243f1f445e83dc43d68656b7e0 2023-11-20 08:54:40,294 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/.tmp/family1/c33c9a243f1f445e83dc43d68656b7e0 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/c33c9a243f1f445e83dc43d68656b7e0 2023-11-20 08:54:40,298 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/c33c9a243f1f445e83dc43d68656b7e0, entries=1, sequenceid=41, filesize=5.0 K 2023-11-20 08:54:40,299 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 559bfeb2e96b535ce0a8d89357bdb240 in 827ms, sequenceid=41, compaction requested=true 2023-11-20 08:54:40,299 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 559bfeb2e96b535ce0a8d89357bdb240: 2023-11-20 08:54:40,299 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240. 2023-11-20 08:54:40,299 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-20 08:54:40,299 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-20 08:54:40,299 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:40,299 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-20 08:54:40,299 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-20 08:54:40,302 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:40,302 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:40,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:40,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:40,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:40,302 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:40,302 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:54:40,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:40,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:40,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:40,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:40,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:40,304 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-20 08:54:40,304 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@22ffb0d1[Count = 0] remaining members to acquire global barrier 2023-11-20 08:54:40,304 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-20 08:54:40,304 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:40,305 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:40,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:40,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:40,305 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-20 08:54:40,305 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-20 08:54:40,305 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:54:40,305 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:40,305 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:54:40,307 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-20 08:54:40,307 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:40,307 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:40,307 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-20 08:54:40,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:40,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:40,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:40,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:40,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:40,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:40,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:40,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:40,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:40,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:40,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:54:40,309 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-20 08:54:40,309 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-20 08:54:40,309 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:54:40,309 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:54:40,309 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:40,309 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:54:40,311 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:40,311 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:40,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:40,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:40,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:40,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:40,311 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:40,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:40,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:40,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:40,311 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:40,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:40,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:40,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:40,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:40,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:40,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:40,313 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:40,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:40,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:40,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:40,318 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:40,318 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:40,318 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:40,318 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:40,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:40,318 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:40,318 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:40,318 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-20 08:54:40,318 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:54:40,318 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:40,318 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:40,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:40,318 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:40,318 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:40,319 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:40,319 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-20 08:54:40,319 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:54:40,319 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:40,419 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:54:40,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:54:40,421 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=36169] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:40,422 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-20 08:54:40,423 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-20 08:54:40,423 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-20 08:54:40,423 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=42, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700471080423 2023-11-20 08:54:40,426 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-20 08:54:40,427 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-11-20 08:54:40,427 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-20 08:54:40,429 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] zookeeper.ReadOnlyZKClient(139): Connect 0x4f5702c0 to 127.0.0.1:64635 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-20 08:54:40,439 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@440f8c5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-20 08:54:40,439 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-20 08:54:41,276 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601030cbb0ce786804c09a76752037d684568 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601030cbb0ce786804c09a76752037d684568 2023-11-20 08:54:41,277 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-20 08:54:41,290 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-20 08:54:41,291 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36388, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-20 08:54:41,297 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-20 08:54:41,298 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60944, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-20 08:54:41,307 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/9b95bac7e24e4ce0905b2daa268a21e8 first=Optional[r3] last=Optional[r6] 2023-11-20 08:54:41,307 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240., hostname=jenkins-hbase4.apache.org,38491,1700470412215, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/9b95bac7e24e4ce0905b2daa268a21e8}] 2023-11-20 08:54:41,312 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(763): Validating hfile at hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/9b95bac7e24e4ce0905b2daa268a21e8 for inclusion in 559bfeb2e96b535ce0a8d89357bdb240/family1 2023-11-20 08:54:41,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-20 08:54:41,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(777): Region bounds: first= last= 2023-11-20 08:54:41,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HRegion(2446): Flush status journal for 559bfeb2e96b535ce0a8d89357bdb240: 2023-11-20 08:54:41,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/9b95bac7e24e4ce0905b2daa268a21e8 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__c4i3jnjsp0ido0q45n667dhopibk3p3tn68ojghbsn3hmth4nf7qtt7jnqv0ng9r/family1/9b95bac7e24e4ce0905b2daa268a21e8 2023-11-20 08:54:41,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__c4i3jnjsp0ido0q45n667dhopibk3p3tn68ojghbsn3hmth4nf7qtt7jnqv0ng9r/family1/9b95bac7e24e4ce0905b2daa268a21e8 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/15456d5563604bb095fd2931028ba2a1_SeqId_44_ 2023-11-20 08:54:41,320 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(849): Loaded HFile hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__c4i3jnjsp0ido0q45n667dhopibk3p3tn68ojghbsn3hmth4nf7qtt7jnqv0ng9r/family1/9b95bac7e24e4ce0905b2daa268a21e8 into 559bfeb2e96b535ce0a8d89357bdb240/family1 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/15456d5563604bb095fd2931028ba2a1_SeqId_44_ - updating store file list. 2023-11-20 08:54:41,323 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(882): Loaded HFile hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/15456d5563604bb095fd2931028ba2a1_SeqId_44_ into 559bfeb2e96b535ce0a8d89357bdb240/family1 2023-11-20 08:54:41,323 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(855): Successfully loaded hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__c4i3jnjsp0ido0q45n667dhopibk3p3tn68ojghbsn3hmth4nf7qtt7jnqv0ng9r/family1/9b95bac7e24e4ce0905b2daa268a21e8 into 559bfeb2e96b535ce0a8d89357bdb240/family1 (new location: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/15456d5563604bb095fd2931028ba2a1_SeqId_44_) 2023-11-20 08:54:41,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__c4i3jnjsp0ido0q45n667dhopibk3p3tn68ojghbsn3hmth4nf7qtt7jnqv0ng9r/family1/9b95bac7e24e4ce0905b2daa268a21e8 2023-11-20 08:54:41,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-20 08:54:41,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51565 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-20 08:54:41,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(1912): 559bfeb2e96b535ce0a8d89357bdb240/family1 is initiating minor compaction 2023-11-20 08:54:41,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@2c3e47d6; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-20 08:54:41,327 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 559bfeb2e96b535ce0a8d89357bdb240/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240. 2023-11-20 08:54:41,327 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/a018c0359c7c44d5b27ac9cfbb4caf15, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/f4c572c22323463e9638e2b3b91aca64, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/ebfc135aca444cb28423fd11779384f1, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/1ea8917de4db4c9b80f39e61575e1367, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/8698844ea59b4690868c6a026499c702, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/56a7f27b99064e59afd20b552dee31bb, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/9ef458e8b3d34093a42cc80f4006f546, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/ddab588e54f74ca8b8a55d7cc4181f1e, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/c33c9a243f1f445e83dc43d68656b7e0, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/15456d5563604bb095fd2931028ba2a1_SeqId_44_] into tmpdir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/.tmp, totalSize=50.4 K 2023-11-20 08:54:41,327 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting a018c0359c7c44d5b27ac9cfbb4caf15, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-20 08:54:41,327 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting f4c572c22323463e9638e2b3b91aca64, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-20 08:54:41,327 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting ebfc135aca444cb28423fd11779384f1, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-20 08:54:41,327 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting 1ea8917de4db4c9b80f39e61575e1367, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-20 08:54:41,327 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting 8698844ea59b4690868c6a026499c702, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-20 08:54:41,327 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting 56a7f27b99064e59afd20b552dee31bb, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-20 08:54:41,328 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting 9ef458e8b3d34093a42cc80f4006f546, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-20 08:54:41,328 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting ddab588e54f74ca8b8a55d7cc4181f1e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-20 08:54:41,328 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting c33c9a243f1f445e83dc43d68656b7e0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-20 08:54:41,328 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting 15456d5563604bb095fd2931028ba2a1_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-20 08:54:41,329 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-20 08:54:41,330 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:54:41,331 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015122877aab8b912aa407587c7beff2528a9bd to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015122877aab8b912aa407587c7beff2528a9bd 2023-11-20 08:54:41,332 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231020ef030b77c43378951c7fdcb15d185 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231020ef030b77c43378951c7fdcb15d185 2023-11-20 08:54:41,333 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101932e799a0ded4b8db476f540145d698c to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101932e799a0ded4b8db476f540145d698c 2023-11-20 08:54:41,334 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601034d012d0844414971b9347e4b946a9d48 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601034d012d0844414971b9347e4b946a9d48 2023-11-20 08:54:41,335 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 4 expired mob files are deleted 2023-11-20 08:54:41,335 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-20 08:54:41,335 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-20 08:54:41,335 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-20 08:54:41,335 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-20 08:54:41,335 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-20 08:54:41,335 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-20 08:54:41,335 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-20 08:54:41,335 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-20 08:54:41,335 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-20 08:54:41,356 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] throttle.PressureAwareThroughputController(145): 559bfeb2e96b535ce0a8d89357bdb240#family1#compaction#60 average throughput is 1.59 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-20 08:54:41,787 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/.tmp/family1/d42ea41fd5184fe2954b3dcdf3d0868d as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/d42ea41fd5184fe2954b3dcdf3d0868d 2023-11-20 08:54:41,793 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 559bfeb2e96b535ce0a8d89357bdb240/family1 of 559bfeb2e96b535ce0a8d89357bdb240 into d42ea41fd5184fe2954b3dcdf3d0868d(size=6.8 K), total size for store is 198.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-20 08:54:41,793 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 559bfeb2e96b535ce0a8d89357bdb240: 2023-11-20 08:54:41,793 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240., storeName=family1, fileCount=10, fileSize=50.4 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1700470481327; duration=0sec 2023-11-20 08:54:41,793 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-20 08:54:41,810 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/a018c0359c7c44d5b27ac9cfbb4caf15, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/f4c572c22323463e9638e2b3b91aca64, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/ebfc135aca444cb28423fd11779384f1, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/1ea8917de4db4c9b80f39e61575e1367, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/8698844ea59b4690868c6a026499c702, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/56a7f27b99064e59afd20b552dee31bb, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/9ef458e8b3d34093a42cc80f4006f546, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/ddab588e54f74ca8b8a55d7cc4181f1e, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/c33c9a243f1f445e83dc43d68656b7e0, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/15456d5563604bb095fd2931028ba2a1_SeqId_44_] to archive 2023-11-20 08:54:41,811 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:54:41,813 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/a018c0359c7c44d5b27ac9cfbb4caf15 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/a018c0359c7c44d5b27ac9cfbb4caf15 2023-11-20 08:54:41,815 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/f4c572c22323463e9638e2b3b91aca64 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/f4c572c22323463e9638e2b3b91aca64 2023-11-20 08:54:41,816 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/ebfc135aca444cb28423fd11779384f1 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/ebfc135aca444cb28423fd11779384f1 2023-11-20 08:54:41,817 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/1ea8917de4db4c9b80f39e61575e1367 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/1ea8917de4db4c9b80f39e61575e1367 2023-11-20 08:54:41,819 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/8698844ea59b4690868c6a026499c702 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/8698844ea59b4690868c6a026499c702 2023-11-20 08:54:41,820 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/56a7f27b99064e59afd20b552dee31bb to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/56a7f27b99064e59afd20b552dee31bb 2023-11-20 08:54:41,821 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/9ef458e8b3d34093a42cc80f4006f546 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/9ef458e8b3d34093a42cc80f4006f546 2023-11-20 08:54:41,822 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/ddab588e54f74ca8b8a55d7cc4181f1e to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/ddab588e54f74ca8b8a55d7cc4181f1e 2023-11-20 08:54:41,823 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/c33c9a243f1f445e83dc43d68656b7e0 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/c33c9a243f1f445e83dc43d68656b7e0 2023-11-20 08:54:41,824 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/15456d5563604bb095fd2931028ba2a1_SeqId_44_ to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/15456d5563604bb095fd2931028ba2a1_SeqId_44_ 2023-11-20 08:54:42,186 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205545d9b563d9c48c398acba3ae8689bad to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205545d9b563d9c48c398acba3ae8689bad 2023-11-20 08:54:42,187 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-20 08:54:42,210 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/d42fc7acbc054654b23409f48224a147 first=Optional[r00] last=Optional[r2] 2023-11-20 08:54:42,211 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240., hostname=jenkins-hbase4.apache.org,38491,1700470412215, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/d42fc7acbc054654b23409f48224a147}] 2023-11-20 08:54:42,213 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(763): Validating hfile at hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/d42fc7acbc054654b23409f48224a147 for inclusion in 559bfeb2e96b535ce0a8d89357bdb240/family1 2023-11-20 08:54:42,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-20 08:54:42,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(777): Region bounds: first= last= 2023-11-20 08:54:42,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HRegion(2446): Flush status journal for 559bfeb2e96b535ce0a8d89357bdb240: 2023-11-20 08:54:42,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/d42fc7acbc054654b23409f48224a147 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__7lv9ge95hp49fdis239ml3ec7d8j6gnv3s4diubie9j5h6lhb93r64mqe8pjpi2p/family1/d42fc7acbc054654b23409f48224a147 2023-11-20 08:54:42,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__7lv9ge95hp49fdis239ml3ec7d8j6gnv3s4diubie9j5h6lhb93r64mqe8pjpi2p/family1/d42fc7acbc054654b23409f48224a147 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/f97a696cf5c54f66ae2199a042285f4b_SeqId_47_ 2023-11-20 08:54:42,220 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(849): Loaded HFile hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__7lv9ge95hp49fdis239ml3ec7d8j6gnv3s4diubie9j5h6lhb93r64mqe8pjpi2p/family1/d42fc7acbc054654b23409f48224a147 into 559bfeb2e96b535ce0a8d89357bdb240/family1 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/f97a696cf5c54f66ae2199a042285f4b_SeqId_47_ - updating store file list. 2023-11-20 08:54:42,225 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(882): Loaded HFile hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/f97a696cf5c54f66ae2199a042285f4b_SeqId_47_ into 559bfeb2e96b535ce0a8d89357bdb240/family1 2023-11-20 08:54:42,225 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(855): Successfully loaded hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__7lv9ge95hp49fdis239ml3ec7d8j6gnv3s4diubie9j5h6lhb93r64mqe8pjpi2p/family1/d42fc7acbc054654b23409f48224a147 into 559bfeb2e96b535ce0a8d89357bdb240/family1 (new location: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/f97a696cf5c54f66ae2199a042285f4b_SeqId_47_) 2023-11-20 08:54:42,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__7lv9ge95hp49fdis239ml3ec7d8j6gnv3s4diubie9j5h6lhb93r64mqe8pjpi2p/family1/d42fc7acbc054654b23409f48224a147 2023-11-20 08:54:42,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-20 08:54:42,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 399433 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-20 08:54:42,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(1912): 559bfeb2e96b535ce0a8d89357bdb240/family1 is initiating minor compaction (all files) 2023-11-20 08:54:42,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@3161979d; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-20 08:54:42,227 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 559bfeb2e96b535ce0a8d89357bdb240/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240. 2023-11-20 08:54:42,227 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/a39f50e6439b485ca56d2009e22527c1, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/d42ea41fd5184fe2954b3dcdf3d0868d, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/f97a696cf5c54f66ae2199a042285f4b_SeqId_47_] into tmpdir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/.tmp, totalSize=390.1 K 2023-11-20 08:54:42,227 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting a39f50e6439b485ca56d2009e22527c1, keycount=1000, bloomtype=ROW, size=191.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878836012 2023-11-20 08:54:42,228 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting d42ea41fd5184fe2954b3dcdf3d0868d, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621236012 2023-11-20 08:54:42,228 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting f97a696cf5c54f66ae2199a042285f4b_SeqId_47_, keycount=1002, bloomtype=ROW, size=191.8 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878836012 2023-11-20 08:54:42,229 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-20 08:54:42,229 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:54:42,231 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130592496d318244f0587fbf138680d9817 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130592496d318244f0587fbf138680d9817 2023-11-20 08:54:42,232 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201e930c2dec37e43b9a333c29238475714 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201e930c2dec37e43b9a333c29238475714 2023-11-20 08:54:42,238 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512050e900cf45e09415291d723c5d98e1249 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512050e900cf45e09415291d723c5d98e1249 2023-11-20 08:54:42,238 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 3 expired mob files are deleted 2023-11-20 08:54:42,238 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-20 08:54:42,239 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-20 08:54:42,239 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-20 08:54:42,239 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-20 08:54:42,240 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=42, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-20 08:54:42,241 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 1.8190 sec 2023-11-20 08:54:42,245 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] throttle.PressureAwareThroughputController(145): 559bfeb2e96b535ce0a8d89357bdb240#family1#compaction#61 average throughput is 25.80 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-20 08:54:42,322 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-20 08:54:42,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure2.ProcedureExecutor(1028): Stored pid=43, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:42,732 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-11-20 08:54:42,733 DEBUG [PEWorker-4] util.FSTableDescriptors(519): Deleted hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-11-20 08:54:42,733 INFO [PEWorker-4] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-11-20 08:54:42,735 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-11-20 08:54:42,737 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=559bfeb2e96b535ce0a8d89357bdb240, REOPEN/MOVE}] 2023-11-20 08:54:42,738 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=559bfeb2e96b535ce0a8d89357bdb240, REOPEN/MOVE 2023-11-20 08:54:42,738 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=559bfeb2e96b535ce0a8d89357bdb240, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:42,738 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700470482738"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700470482738"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700470482738"}]},"ts":"1700470482738"} 2023-11-20 08:54:42,740 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=45, state=RUNNABLE; CloseRegionProcedure 559bfeb2e96b535ce0a8d89357bdb240, server=jenkins-hbase4.apache.org,38491,1700470412215}] 2023-11-20 08:54:42,890 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:42,890 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 559bfeb2e96b535ce0a8d89357bdb240 2023-11-20 08:54:42,890 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 559bfeb2e96b535ce0a8d89357bdb240, disabling compactions & flushes 2023-11-20 08:54:42,890 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240. 2023-11-20 08:54:43,462 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/.tmp/family1/8c875fc9bd4c458186d7293820398d61 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/8c875fc9bd4c458186d7293820398d61 2023-11-20 08:54:43,466 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 559bfeb2e96b535ce0a8d89357bdb240/family1 of 559bfeb2e96b535ce0a8d89357bdb240 into 8c875fc9bd4c458186d7293820398d61(size=193.0 K), total size for store is 193.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-20 08:54:43,466 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 559bfeb2e96b535ce0a8d89357bdb240: 2023-11-20 08:54:43,466 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240. 2023-11-20 08:54:43,466 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240., storeName=family1, fileCount=3, fileSize=390.1 K (191.4 K, 6.8 K, 191.8 K), priority=2, time=1700470482226; duration=1sec 2023-11-20 08:54:43,466 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240. 2023-11-20 08:54:43,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240. after waiting 0 ms 2023-11-20 08:54:43,467 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-20 08:54:43,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240. 2023-11-20 08:54:43,468 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/a39f50e6439b485ca56d2009e22527c1, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/d42ea41fd5184fe2954b3dcdf3d0868d, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/f97a696cf5c54f66ae2199a042285f4b_SeqId_47_] to archive 2023-11-20 08:54:43,469 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:54:43,470 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/a39f50e6439b485ca56d2009e22527c1 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/a39f50e6439b485ca56d2009e22527c1 2023-11-20 08:54:43,471 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/d42ea41fd5184fe2954b3dcdf3d0868d to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/d42ea41fd5184fe2954b3dcdf3d0868d 2023-11-20 08:54:43,472 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/f97a696cf5c54f66ae2199a042285f4b_SeqId_47_ to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/f97a696cf5c54f66ae2199a042285f4b_SeqId_47_ 2023-11-20 08:54:43,476 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-20 08:54:43,477 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240. 2023-11-20 08:54:43,477 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 559bfeb2e96b535ce0a8d89357bdb240: 2023-11-20 08:54:43,477 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 559bfeb2e96b535ce0a8d89357bdb240 to self. 2023-11-20 08:54:43,478 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 559bfeb2e96b535ce0a8d89357bdb240 2023-11-20 08:54:43,479 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=559bfeb2e96b535ce0a8d89357bdb240, regionState=CLOSED 2023-11-20 08:54:43,479 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700470483479"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700470483479"}]},"ts":"1700470483479"} 2023-11-20 08:54:43,481 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=45 2023-11-20 08:54:43,481 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=45, state=SUCCESS; CloseRegionProcedure 559bfeb2e96b535ce0a8d89357bdb240, server=jenkins-hbase4.apache.org,38491,1700470412215 in 740 msec 2023-11-20 08:54:43,482 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=559bfeb2e96b535ce0a8d89357bdb240, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,38491,1700470412215; forceNewPlan=false, retain=true 2023-11-20 08:54:43,632 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=559bfeb2e96b535ce0a8d89357bdb240, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:43,632 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700470483632"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700470483632"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700470483632"}]},"ts":"1700470483632"} 2023-11-20 08:54:43,634 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=47, ppid=45, state=RUNNABLE; OpenRegionProcedure 559bfeb2e96b535ce0a8d89357bdb240, server=jenkins-hbase4.apache.org,38491,1700470412215}] 2023-11-20 08:54:43,785 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:43,788 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240. 2023-11-20 08:54:43,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 559bfeb2e96b535ce0a8d89357bdb240, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240.', STARTKEY => '', ENDKEY => ''} 2023-11-20 08:54:43,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 559bfeb2e96b535ce0a8d89357bdb240 2023-11-20 08:54:43,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-20 08:54:43,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 559bfeb2e96b535ce0a8d89357bdb240 2023-11-20 08:54:43,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 559bfeb2e96b535ce0a8d89357bdb240 2023-11-20 08:54:43,790 INFO [StoreOpener-559bfeb2e96b535ce0a8d89357bdb240-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 559bfeb2e96b535ce0a8d89357bdb240 2023-11-20 08:54:43,790 DEBUG [StoreOpener-559bfeb2e96b535ce0a8d89357bdb240-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1 2023-11-20 08:54:43,790 DEBUG [StoreOpener-559bfeb2e96b535ce0a8d89357bdb240-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1 2023-11-20 08:54:43,791 INFO [StoreOpener-559bfeb2e96b535ce0a8d89357bdb240-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 559bfeb2e96b535ce0a8d89357bdb240 columnFamilyName family1 2023-11-20 08:54:43,795 DEBUG [StoreOpener-559bfeb2e96b535ce0a8d89357bdb240-1] regionserver.HStore(539): loaded hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/8c875fc9bd4c458186d7293820398d61 2023-11-20 08:54:43,795 INFO [StoreOpener-559bfeb2e96b535ce0a8d89357bdb240-1] regionserver.HStore(310): Store=559bfeb2e96b535ce0a8d89357bdb240/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-20 08:54:43,796 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240 2023-11-20 08:54:43,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240 2023-11-20 08:54:43,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 559bfeb2e96b535ce0a8d89357bdb240 2023-11-20 08:54:43,800 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 559bfeb2e96b535ce0a8d89357bdb240; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66495668, jitterRate=-0.009137332439422607}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-20 08:54:43,800 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 559bfeb2e96b535ce0a8d89357bdb240: 2023-11-20 08:54:43,801 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240., pid=47, masterSystemTime=1700470483785 2023-11-20 08:54:43,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240. 2023-11-20 08:54:43,802 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240. 2023-11-20 08:54:43,802 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=559bfeb2e96b535ce0a8d89357bdb240, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:43,802 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700470483802"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700470483802"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700470483802"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700470483802"}]},"ts":"1700470483802"} 2023-11-20 08:54:43,805 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=47, resume processing ppid=45 2023-11-20 08:54:43,805 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=47, ppid=45, state=SUCCESS; OpenRegionProcedure 559bfeb2e96b535ce0a8d89357bdb240, server=jenkins-hbase4.apache.org,38491,1700470412215 in 170 msec 2023-11-20 08:54:43,806 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=44 2023-11-20 08:54:43,806 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=44, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=559bfeb2e96b535ce0a8d89357bdb240, REOPEN/MOVE in 1.0680 sec 2023-11-20 08:54:43,808 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=44, resume processing ppid=43 2023-11-20 08:54:43,808 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=43, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.0720 sec 2023-11-20 08:54:43,809 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=43, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.4870 sec 2023-11-20 08:54:43,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=43 2023-11-20 08:54:43,811 INFO [Listener at localhost/43513] compactions.TestMobCompactor(278): alter status finished 2023-11-20 08:54:43,812 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=36169] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:43,813 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-20 08:54:43,814 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-20 08:54:43,814 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-20 08:54:43,814 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700471083814 2023-11-20 08:54:43,815 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-20 08:54:43,816 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-11-20 08:54:43,816 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-20 08:54:43,817 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] zookeeper.ReadOnlyZKClient(139): Connect 0x47a50239 to 127.0.0.1:64635 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-20 08:54:43,822 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@44204cd8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-20 08:54:43,822 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-20 08:54:43,822 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-20 08:54:43,822 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-20 08:54:43,822 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-20 08:54:43,822 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-20 08:54:44,648 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511284308701f73b04716b590dbebe6a6b7ad to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511284308701f73b04716b590dbebe6a6b7ad 2023-11-20 08:54:44,649 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-20 08:54:44,662 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-20 08:54:44,663 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43850, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-20 08:54:44,670 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-20 08:54:44,672 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47674, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-20 08:54:44,681 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/662cc3d8e2fe4a7cb06d745b06fb82b7 first=Optional[r05] last=Optional[r8] 2023-11-20 08:54:44,682 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240., hostname=jenkins-hbase4.apache.org,38491,1700470412215, seqNum=51 for row with hfile group [{family1,hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/662cc3d8e2fe4a7cb06d745b06fb82b7}] 2023-11-20 08:54:44,686 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(763): Validating hfile at hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/662cc3d8e2fe4a7cb06d745b06fb82b7 for inclusion in 559bfeb2e96b535ce0a8d89357bdb240/family1 2023-11-20 08:54:44,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-11-20 08:54:44,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(777): Region bounds: first= last= 2023-11-20 08:54:44,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HRegion(2446): Flush status journal for 559bfeb2e96b535ce0a8d89357bdb240: 2023-11-20 08:54:44,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/662cc3d8e2fe4a7cb06d745b06fb82b7 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__dl7u675qd0326sqsd96bpbdclrb16jf3jurf6hsjkg70si3c7g7vc1ac961m6llg/family1/662cc3d8e2fe4a7cb06d745b06fb82b7 2023-11-20 08:54:44,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__dl7u675qd0326sqsd96bpbdclrb16jf3jurf6hsjkg70si3c7g7vc1ac961m6llg/family1/662cc3d8e2fe4a7cb06d745b06fb82b7 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/563bd2549261476e9e073fd8fc3d82b8_SeqId_53_ 2023-11-20 08:54:44,693 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(849): Loaded HFile hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__dl7u675qd0326sqsd96bpbdclrb16jf3jurf6hsjkg70si3c7g7vc1ac961m6llg/family1/662cc3d8e2fe4a7cb06d745b06fb82b7 into 559bfeb2e96b535ce0a8d89357bdb240/family1 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/563bd2549261476e9e073fd8fc3d82b8_SeqId_53_ - updating store file list. 2023-11-20 08:54:44,697 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(882): Loaded HFile hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/563bd2549261476e9e073fd8fc3d82b8_SeqId_53_ into 559bfeb2e96b535ce0a8d89357bdb240/family1 2023-11-20 08:54:44,697 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(855): Successfully loaded hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__dl7u675qd0326sqsd96bpbdclrb16jf3jurf6hsjkg70si3c7g7vc1ac961m6llg/family1/662cc3d8e2fe4a7cb06d745b06fb82b7 into 559bfeb2e96b535ce0a8d89357bdb240/family1 (new location: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/563bd2549261476e9e073fd8fc3d82b8_SeqId_53_) 2023-11-20 08:54:44,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__dl7u675qd0326sqsd96bpbdclrb16jf3jurf6hsjkg70si3c7g7vc1ac961m6llg/family1/662cc3d8e2fe4a7cb06d745b06fb82b7 2023-11-20 08:54:44,699 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-20 08:54:44,700 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:54:44,701 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511207c2fa93245be4fafa4298cb62856626d to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511207c2fa93245be4fafa4298cb62856626d 2023-11-20 08:54:44,702 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112819bf5332d1ce4a8b8c108a47881ddafb to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112819bf5332d1ce4a8b8c108a47881ddafb 2023-11-20 08:54:44,702 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2 expired mob files are deleted 2023-11-20 08:54:44,702 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-20 08:54:44,703 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-20 08:54:44,703 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-20 08:54:44,703 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-20 08:54:44,703 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-20 08:54:44,703 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-20 08:54:44,704 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-20 08:54:44,705 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 891 msec 2023-11-20 08:54:44,761 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-20 08:54:44,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:45,171 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-11-20 08:54:45,172 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-11-20 08:54:45,172 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-11-20 08:54:45,174 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=50, ppid=49, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-11-20 08:54:45,177 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=559bfeb2e96b535ce0a8d89357bdb240, REOPEN/MOVE}] 2023-11-20 08:54:45,178 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=559bfeb2e96b535ce0a8d89357bdb240, REOPEN/MOVE 2023-11-20 08:54:45,179 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=559bfeb2e96b535ce0a8d89357bdb240, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:45,179 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700470485178"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700470485178"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700470485178"}]},"ts":"1700470485178"} 2023-11-20 08:54:45,180 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE; CloseRegionProcedure 559bfeb2e96b535ce0a8d89357bdb240, server=jenkins-hbase4.apache.org,38491,1700470412215}] 2023-11-20 08:54:45,331 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:45,332 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 559bfeb2e96b535ce0a8d89357bdb240 2023-11-20 08:54:45,332 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 559bfeb2e96b535ce0a8d89357bdb240, disabling compactions & flushes 2023-11-20 08:54:45,332 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240. 2023-11-20 08:54:45,332 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240. 2023-11-20 08:54:45,332 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240. after waiting 0 ms 2023-11-20 08:54:45,332 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240. 2023-11-20 08:54:45,338 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-11-20 08:54:45,338 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240. 2023-11-20 08:54:45,339 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 559bfeb2e96b535ce0a8d89357bdb240: 2023-11-20 08:54:45,339 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 559bfeb2e96b535ce0a8d89357bdb240 to self. 2023-11-20 08:54:45,340 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 559bfeb2e96b535ce0a8d89357bdb240 2023-11-20 08:54:45,340 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=559bfeb2e96b535ce0a8d89357bdb240, regionState=CLOSED 2023-11-20 08:54:45,340 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700470485340"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700470485340"}]},"ts":"1700470485340"} 2023-11-20 08:54:45,343 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=52, resume processing ppid=51 2023-11-20 08:54:45,343 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; CloseRegionProcedure 559bfeb2e96b535ce0a8d89357bdb240, server=jenkins-hbase4.apache.org,38491,1700470412215 in 162 msec 2023-11-20 08:54:45,343 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=559bfeb2e96b535ce0a8d89357bdb240, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,38491,1700470412215; forceNewPlan=false, retain=true 2023-11-20 08:54:45,493 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=559bfeb2e96b535ce0a8d89357bdb240, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:45,494 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700470485493"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700470485493"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700470485493"}]},"ts":"1700470485493"} 2023-11-20 08:54:45,495 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=53, ppid=51, state=RUNNABLE; OpenRegionProcedure 559bfeb2e96b535ce0a8d89357bdb240, server=jenkins-hbase4.apache.org,38491,1700470412215}] 2023-11-20 08:54:45,647 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:45,649 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240. 2023-11-20 08:54:45,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 559bfeb2e96b535ce0a8d89357bdb240, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240.', STARTKEY => '', ENDKEY => ''} 2023-11-20 08:54:45,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 559bfeb2e96b535ce0a8d89357bdb240 2023-11-20 08:54:45,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-20 08:54:45,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 559bfeb2e96b535ce0a8d89357bdb240 2023-11-20 08:54:45,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 559bfeb2e96b535ce0a8d89357bdb240 2023-11-20 08:54:45,651 INFO [StoreOpener-559bfeb2e96b535ce0a8d89357bdb240-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 559bfeb2e96b535ce0a8d89357bdb240 2023-11-20 08:54:45,652 DEBUG [StoreOpener-559bfeb2e96b535ce0a8d89357bdb240-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1 2023-11-20 08:54:45,652 DEBUG [StoreOpener-559bfeb2e96b535ce0a8d89357bdb240-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1 2023-11-20 08:54:45,652 INFO [StoreOpener-559bfeb2e96b535ce0a8d89357bdb240-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 559bfeb2e96b535ce0a8d89357bdb240 columnFamilyName family1 2023-11-20 08:54:45,657 DEBUG [StoreOpener-559bfeb2e96b535ce0a8d89357bdb240-1] regionserver.HStore(539): loaded hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/563bd2549261476e9e073fd8fc3d82b8_SeqId_53_ 2023-11-20 08:54:45,659 DEBUG [StoreOpener-559bfeb2e96b535ce0a8d89357bdb240-1] regionserver.HStore(539): loaded hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/family1/8c875fc9bd4c458186d7293820398d61 2023-11-20 08:54:45,660 INFO [StoreOpener-559bfeb2e96b535ce0a8d89357bdb240-1] regionserver.HStore(310): Store=559bfeb2e96b535ce0a8d89357bdb240/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-20 08:54:45,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240 2023-11-20 08:54:45,661 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240 2023-11-20 08:54:45,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 559bfeb2e96b535ce0a8d89357bdb240 2023-11-20 08:54:45,665 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 559bfeb2e96b535ce0a8d89357bdb240; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60974589, jitterRate=-0.09140782058238983}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-20 08:54:45,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 559bfeb2e96b535ce0a8d89357bdb240: 2023-11-20 08:54:45,665 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240., pid=53, masterSystemTime=1700470485647 2023-11-20 08:54:45,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240. 2023-11-20 08:54:45,667 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240. 2023-11-20 08:54:45,667 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=559bfeb2e96b535ce0a8d89357bdb240, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:45,667 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700470485667"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700470485667"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700470485667"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700470485667"}]},"ts":"1700470485667"} 2023-11-20 08:54:45,670 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=53, resume processing ppid=51 2023-11-20 08:54:45,670 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; OpenRegionProcedure 559bfeb2e96b535ce0a8d89357bdb240, server=jenkins-hbase4.apache.org,38491,1700470412215 in 173 msec 2023-11-20 08:54:45,671 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=51, resume processing ppid=50 2023-11-20 08:54:45,671 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=51, ppid=50, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=559bfeb2e96b535ce0a8d89357bdb240, REOPEN/MOVE in 493 msec 2023-11-20 08:54:45,673 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=50, resume processing ppid=49 2023-11-20 08:54:45,673 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=50, ppid=49, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 499 msec 2023-11-20 08:54:45,675 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 913 msec 2023-11-20 08:54:45,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=49 2023-11-20 08:54:45,677 INFO [Listener at localhost/43513] compactions.TestMobCompactor(278): alter status finished 2023-11-20 08:54:45,678 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=36169] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-20 08:54:45,679 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] procedure2.ProcedureExecutor(1028): Stored pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-20 08:54:45,679 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-20 08:54:45,680 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-20 08:54:45,680 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=54, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700471085680 2023-11-20 08:54:45,680 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-20 08:54:45,681 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-11-20 08:54:45,681 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-20 08:54:45,682 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] zookeeper.ReadOnlyZKClient(139): Connect 0x20688c28 to 127.0.0.1:64635 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-20 08:54:45,686 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@66e85271, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-20 08:54:45,686 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-20 08:54:45,686 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-20 08:54:45,686 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-20 08:54:45,686 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-20 08:54:45,686 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-20 08:54:45,686 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-20 08:54:45,686 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-20 08:54:45,686 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-20 08:54:45,686 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-20 08:54:45,686 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-20 08:54:45,687 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=54, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-20 08:54:45,688 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=54, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 9 msec 2023-11-20 08:54:45,734 INFO [Listener at localhost/43513] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=247 (was 259), OpenFileDescriptor=654 (was 640) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=113 (was 160), ProcessCount=168 (was 168), AvailableMemoryMB=14765 (was 14769) 2023-11-20 08:54:45,744 INFO [Listener at localhost/43513] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=247, OpenFileDescriptor=654, MaxFileDescriptor=60000, SystemLoadAverage=113, ProcessCount=168, AvailableMemoryMB=14764 2023-11-20 08:54:45,745 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-20 08:54:45,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure2.ProcedureExecutor(1028): Stored pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:45,747 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_PRE_OPERATION 2023-11-20 08:54:45,747 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily" procId is: 55 2023-11-20 08:54:45,748 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-20 08:54:45,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-20 08:54:45,749 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920 2023-11-20 08:54:45,750 DEBUG [HFileArchiver-10] backup.HFileArchiver(153): Directory hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920 empty. 2023-11-20 08:54:45,750 DEBUG [HFileArchiver-10] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920 2023-11-20 08:54:45,750 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily regions 2023-11-20 08:54:45,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-20 08:54:46,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-20 08:54:46,157 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-11-20 08:54:46,159 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(7675): creating {ENCODED => ef901bcc335cc63de4ed78cce9cea920, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp 2023-11-20 08:54:46,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-20 08:54:46,564 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-20 08:54:46,564 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1604): Closing ef901bcc335cc63de4ed78cce9cea920, disabling compactions & flushes 2023-11-20 08:54:46,565 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920. 2023-11-20 08:54:46,565 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920. 2023-11-20 08:54:46,565 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920. after waiting 0 ms 2023-11-20 08:54:46,565 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920. 2023-11-20 08:54:46,565 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920. 2023-11-20 08:54:46,565 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1558): Region close journal for ef901bcc335cc63de4ed78cce9cea920: 2023-11-20 08:54:46,567 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ADD_TO_META 2023-11-20 08:54:46,568 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700470486567"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700470486567"}]},"ts":"1700470486567"} 2023-11-20 08:54:46,569 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-20 08:54:46,569 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-20 08:54:46,570 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700470486570"}]},"ts":"1700470486570"} 2023-11-20 08:54:46,570 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLING in hbase:meta 2023-11-20 08:54:46,574 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=ef901bcc335cc63de4ed78cce9cea920, ASSIGN}] 2023-11-20 08:54:46,575 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=ef901bcc335cc63de4ed78cce9cea920, ASSIGN 2023-11-20 08:54:46,576 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=ef901bcc335cc63de4ed78cce9cea920, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38491,1700470412215; forceNewPlan=false, retain=false 2023-11-20 08:54:46,727 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=ef901bcc335cc63de4ed78cce9cea920, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:46,727 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700470486727"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700470486727"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700470486727"}]},"ts":"1700470486727"} 2023-11-20 08:54:46,729 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=57, ppid=56, state=RUNNABLE; OpenRegionProcedure ef901bcc335cc63de4ed78cce9cea920, server=jenkins-hbase4.apache.org,38491,1700470412215}] 2023-11-20 08:54:46,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-20 08:54:46,880 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:46,883 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920. 2023-11-20 08:54:46,883 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ef901bcc335cc63de4ed78cce9cea920, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920.', STARTKEY => '', ENDKEY => ''} 2023-11-20 08:54:46,883 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily ef901bcc335cc63de4ed78cce9cea920 2023-11-20 08:54:46,883 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-20 08:54:46,883 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ef901bcc335cc63de4ed78cce9cea920 2023-11-20 08:54:46,883 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ef901bcc335cc63de4ed78cce9cea920 2023-11-20 08:54:46,884 INFO [StoreOpener-ef901bcc335cc63de4ed78cce9cea920-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region ef901bcc335cc63de4ed78cce9cea920 2023-11-20 08:54:46,885 DEBUG [StoreOpener-ef901bcc335cc63de4ed78cce9cea920-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1 2023-11-20 08:54:46,886 DEBUG [StoreOpener-ef901bcc335cc63de4ed78cce9cea920-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1 2023-11-20 08:54:46,886 INFO [StoreOpener-ef901bcc335cc63de4ed78cce9cea920-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ef901bcc335cc63de4ed78cce9cea920 columnFamilyName family1 2023-11-20 08:54:46,887 INFO [StoreOpener-ef901bcc335cc63de4ed78cce9cea920-1] regionserver.HStore(310): Store=ef901bcc335cc63de4ed78cce9cea920/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-20 08:54:46,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920 2023-11-20 08:54:46,889 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920 2023-11-20 08:54:46,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ef901bcc335cc63de4ed78cce9cea920 2023-11-20 08:54:46,893 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-20 08:54:46,893 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ef901bcc335cc63de4ed78cce9cea920; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72080514, jitterRate=0.0740833580493927}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-20 08:54:46,893 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ef901bcc335cc63de4ed78cce9cea920: 2023-11-20 08:54:46,894 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920., pid=57, masterSystemTime=1700470486880 2023-11-20 08:54:46,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920. 2023-11-20 08:54:46,895 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920. 2023-11-20 08:54:46,895 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=ef901bcc335cc63de4ed78cce9cea920, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:46,896 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700470486895"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700470486895"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700470486895"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700470486895"}]},"ts":"1700470486895"} 2023-11-20 08:54:46,898 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=57, resume processing ppid=56 2023-11-20 08:54:46,898 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=57, ppid=56, state=SUCCESS; OpenRegionProcedure ef901bcc335cc63de4ed78cce9cea920, server=jenkins-hbase4.apache.org,38491,1700470412215 in 168 msec 2023-11-20 08:54:46,899 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=56, resume processing ppid=55 2023-11-20 08:54:46,899 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=56, ppid=55, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=ef901bcc335cc63de4ed78cce9cea920, ASSIGN in 324 msec 2023-11-20 08:54:46,900 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-20 08:54:46,900 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700470486900"}]},"ts":"1700470486900"} 2023-11-20 08:54:46,901 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLED in hbase:meta 2023-11-20 08:54:46,906 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_POST_OPERATION 2023-11-20 08:54:46,907 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=55, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1610 sec 2023-11-20 08:54:47,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-20 08:54:47,853 INFO [Listener at localhost/43513] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, procId: 55 completed 2023-11-20 08:54:47,873 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:54:47,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:47,875 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-20 08:54:47,875 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:47,875 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-20 08:54:47,875 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-20 08:54:47,876 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:47,876 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:47,877 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:47,877 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:47,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:47,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:47,878 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:47,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:47,878 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:54:47,878 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:47,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:54:47,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:47,879 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:47,879 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:47,879 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-20 08:54:47,879 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:47,879 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-20 08:54:47,880 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-20 08:54:47,880 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920. 2023-11-20 08:54:47,880 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920. started... 2023-11-20 08:54:47,880 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:54:47,881 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ef901bcc335cc63de4ed78cce9cea920 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-20 08:54:48,299 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130d71fbec6fca948088451f9849378e94c to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130d71fbec6fca948088451f9849378e94c 2023-11-20 08:54:48,702 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/.tmp/family1/c7d1177ef40045acba87c606c9bf16ea 2023-11-20 08:54:48,707 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/.tmp/family1/c7d1177ef40045acba87c606c9bf16ea as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/c7d1177ef40045acba87c606c9bf16ea 2023-11-20 08:54:48,712 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/c7d1177ef40045acba87c606c9bf16ea, entries=1000, sequenceid=5, filesize=190.5 K 2023-11-20 08:54:48,712 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for ef901bcc335cc63de4ed78cce9cea920 in 831ms, sequenceid=5, compaction requested=false 2023-11-20 08:54:48,713 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-20 08:54:48,713 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ef901bcc335cc63de4ed78cce9cea920: 2023-11-20 08:54:48,713 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920. 2023-11-20 08:54:48,713 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-20 08:54:48,713 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-20 08:54:48,713 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:48,713 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-20 08:54:48,713 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-20 08:54:48,715 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:48,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:48,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:48,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:48,715 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:48,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:48,715 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:48,715 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:54:48,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:48,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:48,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:48,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:48,717 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-20 08:54:48,717 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2cb49f57[Count = 0] remaining members to acquire global barrier 2023-11-20 08:54:48,717 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-20 08:54:48,717 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:48,718 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:48,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:48,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:48,718 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-20 08:54:48,718 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-20 08:54:48,718 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:48,718 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:54:48,718 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:54:48,721 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:48,721 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-20 08:54:48,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:48,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:48,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:48,721 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:48,721 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-20 08:54:48,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:48,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:48,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:48,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:48,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:48,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:48,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:48,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:54:48,723 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-20 08:54:48,723 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-20 08:54:48,723 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:54:48,723 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:54:48,724 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:48,724 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:54:48,729 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:48,729 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:48,729 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:48,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:48,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:48,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:48,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:48,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:48,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:48,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:48,729 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:48,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:48,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:48,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:48,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:48,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:48,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:48,731 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:48,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:48,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:48,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:48,733 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:48,733 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:48,733 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:48,733 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:48,733 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:48,733 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:48,733 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:48,733 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:48,733 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-20 08:54:48,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:48,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:48,733 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:48,733 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-20 08:54:48,734 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:54:48,733 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:48,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:48,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:48,734 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-20 08:54:48,734 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:54:48,834 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:54:48,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:54:48,839 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:54:48,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-20 08:54:48,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:48,840 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-20 08:54:48,840 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:48,840 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-20 08:54:48,840 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-20 08:54:48,841 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:48,841 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:48,843 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:48,843 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:48,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:48,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:48,844 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:48,844 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:54:48,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:48,844 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:48,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:54:48,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:48,845 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:48,845 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-20 08:54:48,845 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:48,845 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-20 08:54:48,845 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:48,845 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-20 08:54:48,845 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-20 08:54:48,845 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:54:48,845 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920. 2023-11-20 08:54:48,845 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920. started... 2023-11-20 08:54:48,845 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ef901bcc335cc63de4ed78cce9cea920 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-20 08:54:49,008 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-20 08:54:49,258 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128bcaeb7e28d7846f6aec59edec3265d5f to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128bcaeb7e28d7846f6aec59edec3265d5f 2023-11-20 08:54:49,663 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/.tmp/family1/071442b1e8b643e6976ee66a38be11d8 2023-11-20 08:54:49,668 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/.tmp/family1/071442b1e8b643e6976ee66a38be11d8 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/071442b1e8b643e6976ee66a38be11d8 2023-11-20 08:54:49,672 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/071442b1e8b643e6976ee66a38be11d8, entries=1, sequenceid=9, filesize=5.0 K 2023-11-20 08:54:49,673 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for ef901bcc335cc63de4ed78cce9cea920 in 828ms, sequenceid=9, compaction requested=false 2023-11-20 08:54:49,673 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ef901bcc335cc63de4ed78cce9cea920: 2023-11-20 08:54:49,673 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920. 2023-11-20 08:54:49,673 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-20 08:54:49,673 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-20 08:54:49,673 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:49,673 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-20 08:54:49,673 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-20 08:54:49,675 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:49,675 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:49,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:49,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:49,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:49,675 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:49,675 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:54:49,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:49,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:49,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:49,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:49,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:49,676 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-20 08:54:49,676 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1959f8fd[Count = 0] remaining members to acquire global barrier 2023-11-20 08:54:49,676 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-20 08:54:49,677 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:49,678 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:49,678 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:49,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:49,678 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-20 08:54:49,678 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-20 08:54:49,678 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:54:49,678 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:49,678 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:54:49,679 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-20 08:54:49,679 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:49,679 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:49,679 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-20 08:54:49,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:49,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:49,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:49,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:49,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:49,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:49,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:49,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:49,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:49,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:49,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:54:49,682 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-20 08:54:49,682 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-20 08:54:49,682 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:54:49,682 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:54:49,682 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:49,682 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:54:49,684 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:49,684 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:49,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:49,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:49,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:49,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:49,685 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:49,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:49,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:49,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:49,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:49,685 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:49,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:49,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:49,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:49,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:49,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:49,686 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:49,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:49,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:49,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:49,689 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:49,689 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:49,689 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:49,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:49,689 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:49,689 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:49,689 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:49,689 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-20 08:54:49,690 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:54:49,689 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:49,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:49,690 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:49,690 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:49,690 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:49,690 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-20 08:54:49,690 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:54:49,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:49,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:49,790 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:54:49,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:54:49,794 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:54:49,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-20 08:54:49,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:49,796 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-20 08:54:49,796 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:49,796 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-20 08:54:49,796 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-20 08:54:49,796 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:49,796 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:49,798 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:49,798 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:49,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:49,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:49,798 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:49,798 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:54:49,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:49,798 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:49,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:54:49,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:49,799 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:49,799 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-20 08:54:49,799 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:49,799 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-20 08:54:49,799 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:49,799 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-20 08:54:49,799 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-20 08:54:49,799 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:54:49,799 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920. 2023-11-20 08:54:49,799 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920. started... 2023-11-20 08:54:49,799 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ef901bcc335cc63de4ed78cce9cea920 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-20 08:54:50,211 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512010ea64d0c37ae47f5b17aa9e96f49ee95 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512010ea64d0c37ae47f5b17aa9e96f49ee95 2023-11-20 08:54:50,616 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/.tmp/family1/f55b2a16cc49400a91df9389fc90167b 2023-11-20 08:54:50,621 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/.tmp/family1/f55b2a16cc49400a91df9389fc90167b as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/f55b2a16cc49400a91df9389fc90167b 2023-11-20 08:54:50,625 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/f55b2a16cc49400a91df9389fc90167b, entries=1, sequenceid=13, filesize=5.0 K 2023-11-20 08:54:50,626 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ef901bcc335cc63de4ed78cce9cea920 in 827ms, sequenceid=13, compaction requested=true 2023-11-20 08:54:50,626 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ef901bcc335cc63de4ed78cce9cea920: 2023-11-20 08:54:50,626 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920. 2023-11-20 08:54:50,626 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-20 08:54:50,626 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-20 08:54:50,626 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:50,626 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-20 08:54:50,626 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-20 08:54:50,628 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:50,628 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:50,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:50,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:50,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:50,629 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:50,629 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:54:50,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:50,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:50,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:50,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:50,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:50,630 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-20 08:54:50,630 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@14da967c[Count = 0] remaining members to acquire global barrier 2023-11-20 08:54:50,630 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-20 08:54:50,630 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:50,631 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:50,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:50,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:50,632 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-20 08:54:50,632 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-20 08:54:50,632 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:50,632 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:54:50,632 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:54:50,634 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-20 08:54:50,634 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:50,634 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:50,634 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-20 08:54:50,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:50,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:50,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:50,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:50,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:50,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:50,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:50,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:50,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:50,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:50,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:54:50,636 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-20 08:54:50,636 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-20 08:54:50,636 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:54:50,636 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:54:50,636 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:50,636 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:54:50,639 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:50,639 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:50,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:50,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:50,639 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:50,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:50,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:50,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:50,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:50,639 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:50,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:50,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:50,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:50,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:50,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:50,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:50,640 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:50,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:50,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:50,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:50,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:50,647 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:50,647 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:50,647 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:50,647 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:50,648 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:50,648 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-20 08:54:50,647 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:50,648 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-20 08:54:50,648 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:54:50,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:50,647 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:50,648 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:50,648 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:50,648 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:50,648 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:50,648 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-20 08:54:50,648 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:54:50,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:50,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:50,748 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:54:50,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:54:50,752 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:54:50,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-20 08:54:50,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:50,754 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-20 08:54:50,754 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:50,754 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-20 08:54:50,754 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-20 08:54:50,755 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:50,755 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:50,762 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:50,762 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:50,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:50,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:50,762 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:50,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:50,762 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:54:50,762 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:50,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:54:50,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:50,763 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:50,763 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-20 08:54:50,763 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:50,763 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-20 08:54:50,763 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:50,763 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-20 08:54:50,763 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-20 08:54:50,763 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:54:50,763 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920. 2023-11-20 08:54:50,763 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920. started... 2023-11-20 08:54:50,763 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ef901bcc335cc63de4ed78cce9cea920 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-20 08:54:51,176 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205f4b5102e1af04b3fb3b7402aea5d272d to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205f4b5102e1af04b3fb3b7402aea5d272d 2023-11-20 08:54:51,582 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/.tmp/family1/794a2101b5ab406fbe14985d7a563b2f 2023-11-20 08:54:51,586 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/.tmp/family1/794a2101b5ab406fbe14985d7a563b2f as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/794a2101b5ab406fbe14985d7a563b2f 2023-11-20 08:54:51,590 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/794a2101b5ab406fbe14985d7a563b2f, entries=1, sequenceid=17, filesize=5.0 K 2023-11-20 08:54:51,590 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ef901bcc335cc63de4ed78cce9cea920 in 827ms, sequenceid=17, compaction requested=true 2023-11-20 08:54:51,591 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ef901bcc335cc63de4ed78cce9cea920: 2023-11-20 08:54:51,591 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920. 2023-11-20 08:54:51,591 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-20 08:54:51,591 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-20 08:54:51,591 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:51,591 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-20 08:54:51,591 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-20 08:54:51,592 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:51,592 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:51,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:51,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:51,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:51,593 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:51,593 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:54:51,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:51,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:51,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:51,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:51,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:51,594 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-20 08:54:51,594 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4bfcc50e[Count = 0] remaining members to acquire global barrier 2023-11-20 08:54:51,594 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-20 08:54:51,594 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:51,596 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:51,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:51,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:51,596 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-20 08:54:51,596 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-20 08:54:51,596 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:54:51,596 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:51,596 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:54:51,598 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:51,598 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-20 08:54:51,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:51,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:51,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:51,598 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:51,598 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-20 08:54:51,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:51,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:51,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:51,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:51,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:51,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:51,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:51,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:54:51,600 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-20 08:54:51,600 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-20 08:54:51,600 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:54:51,600 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:54:51,600 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:51,600 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:54:51,602 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:51,602 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:51,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:51,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:51,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:51,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:51,602 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:51,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:51,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:51,603 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:51,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:51,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:51,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:51,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:51,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:51,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:51,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:51,604 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:51,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:51,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:51,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:51,606 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:51,606 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:51,606 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:51,607 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:51,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:51,606 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:51,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:51,607 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-20 08:54:51,607 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:54:51,607 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:51,607 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:51,607 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:51,607 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:51,607 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:51,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:51,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:51,607 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-20 08:54:51,607 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:54:51,707 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:54:51,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:54:51,711 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:54:51,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-20 08:54:51,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:51,713 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-20 08:54:51,713 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:51,713 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-20 08:54:51,713 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-20 08:54:51,713 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:51,713 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:51,715 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:51,715 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:51,716 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:51,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:51,716 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:51,716 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:54:51,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:51,716 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:51,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:54:51,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:51,717 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:51,717 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-20 08:54:51,717 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:51,717 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-20 08:54:51,717 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:51,717 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-20 08:54:51,717 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-20 08:54:51,717 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:54:51,717 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920. 2023-11-20 08:54:51,717 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920. started... 2023-11-20 08:54:51,717 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ef901bcc335cc63de4ed78cce9cea920 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-20 08:54:52,132 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122890addad9ce1a477c8072a2f22fbb8ee8 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015122890addad9ce1a477c8072a2f22fbb8ee8 2023-11-20 08:54:52,537 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/.tmp/family1/0df1a608b9334759a5778c6d1668ae66 2023-11-20 08:54:52,542 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/.tmp/family1/0df1a608b9334759a5778c6d1668ae66 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/0df1a608b9334759a5778c6d1668ae66 2023-11-20 08:54:52,545 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/0df1a608b9334759a5778c6d1668ae66, entries=1, sequenceid=21, filesize=5.0 K 2023-11-20 08:54:52,546 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ef901bcc335cc63de4ed78cce9cea920 in 829ms, sequenceid=21, compaction requested=true 2023-11-20 08:54:52,546 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ef901bcc335cc63de4ed78cce9cea920: 2023-11-20 08:54:52,546 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920. 2023-11-20 08:54:52,546 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-20 08:54:52,546 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-20 08:54:52,546 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:52,546 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-20 08:54:52,546 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-20 08:54:52,548 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:52,548 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:52,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:52,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:52,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:52,548 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:52,548 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:54:52,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:52,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:52,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:52,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:52,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:52,550 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-20 08:54:52,550 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43bab501[Count = 0] remaining members to acquire global barrier 2023-11-20 08:54:52,550 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-20 08:54:52,550 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:52,551 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:52,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:52,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:52,551 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-20 08:54:52,551 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-20 08:54:52,551 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:54:52,551 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:52,551 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:54:52,552 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-20 08:54:52,552 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:52,552 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:52,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:52,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:52,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:52,552 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-20 08:54:52,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:52,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:52,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:52,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:52,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:52,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:52,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:52,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:54:52,555 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-20 08:54:52,555 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-20 08:54:52,555 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:54:52,555 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:54:52,555 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:52,555 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:54:52,557 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:52,557 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:52,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:52,558 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:52,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:52,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:52,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:52,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:52,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:52,558 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:52,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:52,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:52,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:52,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:52,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:52,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:52,559 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:52,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:52,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:52,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:52,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:52,561 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:52,561 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:52,561 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:52,561 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:52,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:52,561 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-20 08:54:52,561 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:54:52,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:52,561 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:52,561 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:52,561 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:52,562 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:52,562 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-20 08:54:52,562 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:52,562 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-20 08:54:52,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:52,562 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:52,562 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:54:52,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:52,662 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:54:52,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:54:52,666 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:54:52,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-20 08:54:52,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:52,668 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-20 08:54:52,668 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:52,668 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-20 08:54:52,668 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-20 08:54:52,669 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:52,669 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:52,670 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:52,670 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:52,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:52,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:52,670 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:52,671 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:54:52,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:52,671 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:52,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:54:52,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:52,671 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:52,671 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-20 08:54:52,671 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:52,672 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-20 08:54:52,672 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:52,672 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-20 08:54:52,672 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-20 08:54:52,672 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:54:52,672 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920. 2023-11-20 08:54:52,672 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920. started... 2023-11-20 08:54:52,672 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ef901bcc335cc63de4ed78cce9cea920 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-20 08:54:53,084 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231f2378df28d0b4a7fa3cbdb03bf6ea152 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231f2378df28d0b4a7fa3cbdb03bf6ea152 2023-11-20 08:54:53,490 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/.tmp/family1/0fe45ffab7c941c9a5febd1c5ecbc288 2023-11-20 08:54:53,494 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/.tmp/family1/0fe45ffab7c941c9a5febd1c5ecbc288 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/0fe45ffab7c941c9a5febd1c5ecbc288 2023-11-20 08:54:53,499 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/0fe45ffab7c941c9a5febd1c5ecbc288, entries=1, sequenceid=25, filesize=5.0 K 2023-11-20 08:54:53,499 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ef901bcc335cc63de4ed78cce9cea920 in 827ms, sequenceid=25, compaction requested=true 2023-11-20 08:54:53,500 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ef901bcc335cc63de4ed78cce9cea920: 2023-11-20 08:54:53,500 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920. 2023-11-20 08:54:53,500 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-20 08:54:53,500 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-20 08:54:53,500 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:53,500 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-20 08:54:53,500 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-20 08:54:53,503 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:53,503 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:53,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:53,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:53,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:53,503 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:53,503 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:54:53,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:53,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:53,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:53,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:53,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:53,505 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-20 08:54:53,505 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@15f2239b[Count = 0] remaining members to acquire global barrier 2023-11-20 08:54:53,505 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-20 08:54:53,505 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:53,506 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:53,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:53,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:53,507 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-20 08:54:53,507 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-20 08:54:53,507 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:54:53,507 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:53,507 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:54:53,508 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-20 08:54:53,508 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:53,508 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:53,508 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-20 08:54:53,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:53,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:53,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:53,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:53,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:53,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:53,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:53,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:53,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:53,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:53,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:54:53,511 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-20 08:54:53,511 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-20 08:54:53,511 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:54:53,511 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:54:53,511 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:53,511 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:54:53,513 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:53,513 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:53,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:53,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:53,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:53,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:53,513 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:53,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:53,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:53,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:53,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:53,514 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:53,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:53,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:53,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:53,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:53,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:53,515 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:53,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:53,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:53,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:53,518 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:53,518 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:53,518 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:53,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:53,518 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-20 08:54:53,518 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:54:53,518 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:53,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:53,518 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:53,518 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:53,518 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:53,518 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:53,518 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-20 08:54:53,518 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:53,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:53,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:53,519 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:53,519 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:54:53,619 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:54:53,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:54:53,623 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:54:53,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-20 08:54:53,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:53,625 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-20 08:54:53,625 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:53,625 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-20 08:54:53,625 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-20 08:54:53,625 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:53,625 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:53,627 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:53,627 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:53,627 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:53,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:53,627 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:53,627 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:54:53,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:53,627 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:53,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:54:53,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:53,628 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:53,628 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-20 08:54:53,628 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:53,628 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-20 08:54:53,628 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:53,628 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-20 08:54:53,628 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-20 08:54:53,628 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:54:53,628 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920. 2023-11-20 08:54:53,629 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920. started... 2023-11-20 08:54:53,629 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ef901bcc335cc63de4ed78cce9cea920 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-20 08:54:54,043 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101927a28c8b9a048248308a5502776ccb5 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101927a28c8b9a048248308a5502776ccb5 2023-11-20 08:54:54,449 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/.tmp/family1/c5feeb8793944c6f97bfec54e61093e9 2023-11-20 08:54:54,454 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/.tmp/family1/c5feeb8793944c6f97bfec54e61093e9 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/c5feeb8793944c6f97bfec54e61093e9 2023-11-20 08:54:54,458 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/c5feeb8793944c6f97bfec54e61093e9, entries=1, sequenceid=29, filesize=5.0 K 2023-11-20 08:54:54,459 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ef901bcc335cc63de4ed78cce9cea920 in 830ms, sequenceid=29, compaction requested=true 2023-11-20 08:54:54,459 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ef901bcc335cc63de4ed78cce9cea920: 2023-11-20 08:54:54,459 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920. 2023-11-20 08:54:54,459 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-20 08:54:54,459 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-20 08:54:54,460 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:54,460 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-20 08:54:54,460 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-20 08:54:54,461 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:54,461 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:54,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:54,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:54,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:54,462 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:54,462 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:54:54,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:54,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:54,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:54,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:54,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:54,464 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-20 08:54:54,464 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@55db3e2f[Count = 0] remaining members to acquire global barrier 2023-11-20 08:54:54,464 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-20 08:54:54,464 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:54,465 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:54,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:54,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:54,466 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-20 08:54:54,466 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-20 08:54:54,466 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:54:54,466 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:54,466 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:54:54,468 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-20 08:54:54,468 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:54,468 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:54,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:54,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:54,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:54,468 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-20 08:54:54,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:54,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:54,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:54,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:54,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:54,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:54,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:54,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:54:54,472 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-20 08:54:54,472 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-20 08:54:54,472 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:54:54,472 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:54:54,472 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:54,472 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:54:54,474 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:54,474 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:54,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:54,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:54,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:54,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:54,474 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:54,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:54,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:54,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:54,475 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:54,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:54,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:54,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:54,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:54,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:54,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:54,476 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:54,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:54,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:54,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:54,480 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:54,480 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:54,480 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:54,480 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:54,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:54,480 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:54,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:54,480 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:54,480 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-20 08:54:54,480 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-20 08:54:54,480 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:54:54,480 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:54,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:54,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:54,480 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:54,480 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:54,480 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:54,480 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-20 08:54:54,481 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:54:54,581 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:54:54,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:54:54,585 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:54:54,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-20 08:54:54,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:54,587 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-20 08:54:54,587 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:54,587 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-20 08:54:54,587 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-20 08:54:54,588 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:54,588 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:54,589 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:54,589 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:54,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:54,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:54,590 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:54,590 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:54:54,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:54,590 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:54,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:54:54,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:54,591 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:54,591 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-20 08:54:54,591 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:54,591 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-20 08:54:54,591 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:54,591 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-20 08:54:54,591 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-20 08:54:54,592 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:54:54,592 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920. 2023-11-20 08:54:54,592 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920. started... 2023-11-20 08:54:54,592 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ef901bcc335cc63de4ed78cce9cea920 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-20 08:54:54,605 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010358194c8a1c0144a999a2dcbb5ab86a48 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010358194c8a1c0144a999a2dcbb5ab86a48 2023-11-20 08:54:54,610 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/.tmp/family1/19b6c10eeb31446a90f3c857fa9b1507 2023-11-20 08:54:54,615 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/.tmp/family1/19b6c10eeb31446a90f3c857fa9b1507 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/19b6c10eeb31446a90f3c857fa9b1507 2023-11-20 08:54:54,619 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/19b6c10eeb31446a90f3c857fa9b1507, entries=1, sequenceid=33, filesize=5.0 K 2023-11-20 08:54:54,620 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ef901bcc335cc63de4ed78cce9cea920 in 27ms, sequenceid=33, compaction requested=true 2023-11-20 08:54:54,620 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ef901bcc335cc63de4ed78cce9cea920: 2023-11-20 08:54:54,620 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920. 2023-11-20 08:54:54,620 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-20 08:54:54,620 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-20 08:54:54,620 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:54,620 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-20 08:54:54,620 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-20 08:54:54,623 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:54,623 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:54,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:54,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:54,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:54,623 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:54,623 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:54:54,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:54,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:54,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:54,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:54,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:54,630 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-20 08:54:54,631 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7822552f[Count = 0] remaining members to acquire global barrier 2023-11-20 08:54:54,631 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-20 08:54:54,631 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:54,633 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:54,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:54,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:54,633 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-20 08:54:54,633 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-20 08:54:54,633 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:54,633 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:54:54,633 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:54:54,637 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:54,637 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-20 08:54:54,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:54,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:54,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:54,637 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:54,637 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-20 08:54:54,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:54,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:54,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:54,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:54,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:54,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:54,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:54,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:54:54,641 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-20 08:54:54,641 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-20 08:54:54,641 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:54:54,641 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:54:54,641 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:54,641 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:54:54,643 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:54,643 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:54,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:54,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:54,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:54,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:54,643 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:54,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:54,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:54,644 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:54,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:54,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:54,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:54,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:54,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:54,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:54,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:54,646 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:54,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:54,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:54,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:54,649 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:54,649 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:54,649 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:54,649 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:54,649 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:54,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:54,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:54,649 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-20 08:54:54,649 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:54:54,649 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:54,649 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-20 08:54:54,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:54,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:54,649 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:54,650 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-20 08:54:54,650 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:54:54,650 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:54,650 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:54,650 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:54,750 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:54:54,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:54:54,755 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:54:54,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-20 08:54:54,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:54,757 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-20 08:54:54,757 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:54,757 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-20 08:54:54,757 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-20 08:54:54,757 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:54,757 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:54,760 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:54,760 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:54,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:54,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:54,760 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:54,760 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:54:54,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:54,760 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:54,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:54:54,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:54,761 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:54,761 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-20 08:54:54,761 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:54,761 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-20 08:54:54,761 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:54,761 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-20 08:54:54,762 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-20 08:54:54,762 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:54:54,762 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920. 2023-11-20 08:54:54,762 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920. started... 2023-11-20 08:54:54,762 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ef901bcc335cc63de4ed78cce9cea920 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-20 08:54:54,972 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-20 08:54:54,973 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x47a50239 to 127.0.0.1:64635 2023-11-20 08:54:54,973 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-20 08:54:54,973 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x20688c28 to 127.0.0.1:64635 2023-11-20 08:54:54,974 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-20 08:54:54,974 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-20 08:54:54,974 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4f5702c0 to 127.0.0.1:64635 2023-11-20 08:54:54,974 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-20 08:54:54,974 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-20 08:54:54,974 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x602be6b3 to 127.0.0.1:64635 2023-11-20 08:54:54,974 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-20 08:54:55,179 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907546af9112b284183a46cd24fe3765df9 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20150907546af9112b284183a46cd24fe3765df9 2023-11-20 08:54:55,585 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/.tmp/family1/a4789a8f15f44f34b33e2f67d11242c7 2023-11-20 08:54:55,589 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/.tmp/family1/a4789a8f15f44f34b33e2f67d11242c7 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/a4789a8f15f44f34b33e2f67d11242c7 2023-11-20 08:54:55,592 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/a4789a8f15f44f34b33e2f67d11242c7, entries=1, sequenceid=37, filesize=5.0 K 2023-11-20 08:54:55,593 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ef901bcc335cc63de4ed78cce9cea920 in 831ms, sequenceid=37, compaction requested=true 2023-11-20 08:54:55,593 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ef901bcc335cc63de4ed78cce9cea920: 2023-11-20 08:54:55,593 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920. 2023-11-20 08:54:55,593 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-20 08:54:55,593 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-20 08:54:55,593 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:55,594 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-20 08:54:55,594 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-20 08:54:55,595 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:55,595 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:55,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:55,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:55,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:55,596 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:55,596 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:54:55,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:55,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:55,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:55,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:55,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:55,597 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-20 08:54:55,598 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6e26f597[Count = 0] remaining members to acquire global barrier 2023-11-20 08:54:55,598 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-20 08:54:55,598 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:55,600 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:55,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:55,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:55,600 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-20 08:54:55,600 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-20 08:54:55,600 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:54:55,600 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:55,600 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:54:55,601 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-20 08:54:55,601 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:55,601 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:55,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:55,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:55,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:55,602 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-20 08:54:55,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:55,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:55,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:55,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:55,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:55,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:55,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:55,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:54:55,605 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-20 08:54:55,605 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-20 08:54:55,605 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:54:55,605 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:54:55,605 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:55,605 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:54:55,607 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:55,607 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:55,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:55,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:55,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:55,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:55,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:55,607 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:55,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:55,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:55,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:55,607 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:55,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:55,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:55,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:55,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:55,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:55,608 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:55,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:55,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:55,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:55,611 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:55,611 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:55,611 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:55,611 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:55,611 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:55,611 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:55,611 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:55,611 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-20 08:54:55,611 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:54:55,611 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:55,611 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:55,611 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:55,611 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:55,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:55,611 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-20 08:54:55,612 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:54:55,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:55,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:55,712 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:54:55,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:54:55,716 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:54:55,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-20 08:54:55,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:55,717 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-20 08:54:55,717 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:55,717 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-20 08:54:55,717 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-20 08:54:55,718 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:55,718 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:55,720 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:55,720 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:55,720 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:55,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:55,720 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:55,720 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:54:55,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:55,720 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:55,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:54:55,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:55,721 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:55,721 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-20 08:54:55,721 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:55,721 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-20 08:54:55,721 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:54:55,721 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-20 08:54:55,721 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-20 08:54:55,721 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:54:55,721 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920. 2023-11-20 08:54:55,721 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920. started... 2023-11-20 08:54:55,721 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ef901bcc335cc63de4ed78cce9cea920 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-20 08:54:56,134 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511207822563ea82a44a4b63f6f554a7af64b to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511207822563ea82a44a4b63f6f554a7af64b 2023-11-20 08:54:56,539 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/.tmp/family1/f8179b25928f45f8a709a2ed47ddeab5 2023-11-20 08:54:56,544 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/.tmp/family1/f8179b25928f45f8a709a2ed47ddeab5 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/f8179b25928f45f8a709a2ed47ddeab5 2023-11-20 08:54:56,548 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/f8179b25928f45f8a709a2ed47ddeab5, entries=1, sequenceid=41, filesize=5.0 K 2023-11-20 08:54:56,549 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ef901bcc335cc63de4ed78cce9cea920 in 828ms, sequenceid=41, compaction requested=true 2023-11-20 08:54:56,549 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ef901bcc335cc63de4ed78cce9cea920: 2023-11-20 08:54:56,549 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920. 2023-11-20 08:54:56,549 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-20 08:54:56,549 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-20 08:54:56,549 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:56,549 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-20 08:54:56,549 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-20 08:54:56,551 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:56,551 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:56,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:56,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:56,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:56,551 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:56,551 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:54:56,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:56,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:56,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:56,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:56,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:56,553 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-20 08:54:56,553 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6a4ced33[Count = 0] remaining members to acquire global barrier 2023-11-20 08:54:56,553 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-20 08:54:56,553 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:56,554 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:56,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:56,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:56,554 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-20 08:54:56,554 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-20 08:54:56,554 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:54:56,554 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:56,554 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:54:56,556 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:56,556 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-20 08:54:56,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:56,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:56,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:56,556 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:56,556 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-20 08:54:56,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:56,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:56,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:56,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:56,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:56,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:56,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:56,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:54:56,558 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-20 08:54:56,558 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-20 08:54:56,558 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:54:56,558 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:54:56,558 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:56,558 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:54:56,563 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:56,563 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:56,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:56,563 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:56,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:56,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:56,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:54:56,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:54:56,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:56,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:56,564 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:56,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:54:56,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:56,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:56,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:54:56,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:56,565 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:56,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:56,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:54:56,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:56,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:56,567 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:56,567 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:56,567 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:54:56,568 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:54:56,568 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:54:56,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:54:56,568 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:56,568 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:56,568 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:54:56,568 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:56,568 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:56,568 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:56,568 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-20 08:54:56,568 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:54:56,568 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:54:56,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:54:56,568 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-20 08:54:56,568 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-20 08:54:56,568 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:54:56,668 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:54:56,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:54:56,670 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=36169] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:56,672 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] procedure2.ProcedureExecutor(1028): Stored pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-20 08:54:56,672 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-20 08:54:56,673 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=58, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700471096673 2023-11-20 08:54:56,673 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-20 08:54:56,676 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-20 08:54:56,676 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-11-20 08:54:56,676 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-20 08:54:56,678 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] zookeeper.ReadOnlyZKClient(139): Connect 0x3fa9fd61 to 127.0.0.1:64635 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-20 08:54:56,682 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3ae48251, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-20 08:54:56,682 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-20 08:54:57,525 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103fa3ba0cc17d44417a4bffb6e87269584 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103fa3ba0cc17d44417a4bffb6e87269584 2023-11-20 08:54:57,526 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-20 08:54:57,538 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-20 08:54:57,539 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55496, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-20 08:54:57,546 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-20 08:54:57,547 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45662, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-20 08:54:57,554 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/a8a459e2fbb744088c5e3b17bdb10d1a first=Optional[r3] last=Optional[r6] 2023-11-20 08:54:57,554 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920., hostname=jenkins-hbase4.apache.org,38491,1700470412215, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/a8a459e2fbb744088c5e3b17bdb10d1a}] 2023-11-20 08:54:57,558 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(763): Validating hfile at hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/a8a459e2fbb744088c5e3b17bdb10d1a for inclusion in ef901bcc335cc63de4ed78cce9cea920/family1 2023-11-20 08:54:57,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-20 08:54:57,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(777): Region bounds: first= last= 2023-11-20 08:54:57,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HRegion(2446): Flush status journal for ef901bcc335cc63de4ed78cce9cea920: 2023-11-20 08:54:57,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/a8a459e2fbb744088c5e3b17bdb10d1a to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__3jif5to6og40blaqfgb9amcefn2ucjqqlhjj47blhvba7mjni712m645jh8b69jr/family1/a8a459e2fbb744088c5e3b17bdb10d1a 2023-11-20 08:54:57,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__3jif5to6og40blaqfgb9amcefn2ucjqqlhjj47blhvba7mjni712m645jh8b69jr/family1/a8a459e2fbb744088c5e3b17bdb10d1a as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/0ea89b28657d48f1b9f7d01ebc1b4f4e_SeqId_44_ 2023-11-20 08:54:57,563 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(849): Loaded HFile hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__3jif5to6og40blaqfgb9amcefn2ucjqqlhjj47blhvba7mjni712m645jh8b69jr/family1/a8a459e2fbb744088c5e3b17bdb10d1a into ef901bcc335cc63de4ed78cce9cea920/family1 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/0ea89b28657d48f1b9f7d01ebc1b4f4e_SeqId_44_ - updating store file list. 2023-11-20 08:54:57,566 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(882): Loaded HFile hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/0ea89b28657d48f1b9f7d01ebc1b4f4e_SeqId_44_ into ef901bcc335cc63de4ed78cce9cea920/family1 2023-11-20 08:54:57,566 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(855): Successfully loaded hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__3jif5to6og40blaqfgb9amcefn2ucjqqlhjj47blhvba7mjni712m645jh8b69jr/family1/a8a459e2fbb744088c5e3b17bdb10d1a into ef901bcc335cc63de4ed78cce9cea920/family1 (new location: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/0ea89b28657d48f1b9f7d01ebc1b4f4e_SeqId_44_) 2023-11-20 08:54:57,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__3jif5to6og40blaqfgb9amcefn2ucjqqlhjj47blhvba7mjni712m645jh8b69jr/family1/a8a459e2fbb744088c5e3b17bdb10d1a 2023-11-20 08:54:57,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-20 08:54:57,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51552 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-20 08:54:57,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(1912): ef901bcc335cc63de4ed78cce9cea920/family1 is initiating minor compaction 2023-11-20 08:54:57,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@21a12c4f; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-20 08:54:57,569 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of ef901bcc335cc63de4ed78cce9cea920/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920. 2023-11-20 08:54:57,569 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/071442b1e8b643e6976ee66a38be11d8, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/f55b2a16cc49400a91df9389fc90167b, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/794a2101b5ab406fbe14985d7a563b2f, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/0df1a608b9334759a5778c6d1668ae66, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/0fe45ffab7c941c9a5febd1c5ecbc288, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/c5feeb8793944c6f97bfec54e61093e9, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/19b6c10eeb31446a90f3c857fa9b1507, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/a4789a8f15f44f34b33e2f67d11242c7, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/f8179b25928f45f8a709a2ed47ddeab5, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/0ea89b28657d48f1b9f7d01ebc1b4f4e_SeqId_44_] into tmpdir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/.tmp, totalSize=50.3 K 2023-11-20 08:54:57,569 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting 071442b1e8b643e6976ee66a38be11d8, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-20 08:54:57,569 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting f55b2a16cc49400a91df9389fc90167b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-20 08:54:57,569 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting 794a2101b5ab406fbe14985d7a563b2f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-20 08:54:57,569 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting 0df1a608b9334759a5778c6d1668ae66, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-20 08:54:57,570 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting 0fe45ffab7c941c9a5febd1c5ecbc288, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-20 08:54:57,570 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting c5feeb8793944c6f97bfec54e61093e9, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-20 08:54:57,570 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting 19b6c10eeb31446a90f3c857fa9b1507, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-20 08:54:57,570 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting a4789a8f15f44f34b33e2f67d11242c7, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-20 08:54:57,570 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting f8179b25928f45f8a709a2ed47ddeab5, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-20 08:54:57,570 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting 0ea89b28657d48f1b9f7d01ebc1b4f4e_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-20 08:54:57,571 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-20 08:54:57,571 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:54:57,573 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015122890addad9ce1a477c8072a2f22fbb8ee8 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015122890addad9ce1a477c8072a2f22fbb8ee8 2023-11-20 08:54:57,574 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231f2378df28d0b4a7fa3cbdb03bf6ea152 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231f2378df28d0b4a7fa3cbdb03bf6ea152 2023-11-20 08:54:57,575 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101927a28c8b9a048248308a5502776ccb5 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101927a28c8b9a048248308a5502776ccb5 2023-11-20 08:54:57,576 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010358194c8a1c0144a999a2dcbb5ab86a48 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010358194c8a1c0144a999a2dcbb5ab86a48 2023-11-20 08:54:57,576 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 4 expired mob files are deleted 2023-11-20 08:54:57,576 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-20 08:54:57,576 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-20 08:54:57,576 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-20 08:54:57,576 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-20 08:54:57,576 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-20 08:54:57,576 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-20 08:54:57,576 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-20 08:54:57,577 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-20 08:54:57,577 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-20 08:54:57,606 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] throttle.PressureAwareThroughputController(145): ef901bcc335cc63de4ed78cce9cea920#family1#compaction#72 average throughput is 1.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-20 08:54:58,420 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/.tmp/family1/5cc702c378014d0bb5d3631b10431ee7 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/5cc702c378014d0bb5d3631b10431ee7 2023-11-20 08:54:58,424 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in ef901bcc335cc63de4ed78cce9cea920/family1 of ef901bcc335cc63de4ed78cce9cea920 into 5cc702c378014d0bb5d3631b10431ee7(size=6.8 K), total size for store is 197.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-20 08:54:58,425 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for ef901bcc335cc63de4ed78cce9cea920: 2023-11-20 08:54:58,425 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920., storeName=family1, fileCount=10, fileSize=50.3 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1700470497569; duration=0sec 2023-11-20 08:54:58,425 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-20 08:54:58,426 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512057a6f765149194dd69b6b4fcac20b641d to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512057a6f765149194dd69b6b4fcac20b641d 2023-11-20 08:54:58,427 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-20 08:54:58,449 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/a96f6c47c65b48188fd215debfd002da first=Optional[r00] last=Optional[r2] 2023-11-20 08:54:58,449 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920., hostname=jenkins-hbase4.apache.org,38491,1700470412215, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/a96f6c47c65b48188fd215debfd002da}] 2023-11-20 08:54:58,451 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(763): Validating hfile at hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/a96f6c47c65b48188fd215debfd002da for inclusion in ef901bcc335cc63de4ed78cce9cea920/family1 2023-11-20 08:54:58,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-20 08:54:58,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(777): Region bounds: first= last= 2023-11-20 08:54:58,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HRegion(2446): Flush status journal for ef901bcc335cc63de4ed78cce9cea920: 2023-11-20 08:54:58,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/a96f6c47c65b48188fd215debfd002da to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__f1nkjmgiqiq0h4nl166rgsfbssumuc0oi12l2m5lj2lssqcpr520unrgamokejfd/family1/a96f6c47c65b48188fd215debfd002da 2023-11-20 08:54:58,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__f1nkjmgiqiq0h4nl166rgsfbssumuc0oi12l2m5lj2lssqcpr520unrgamokejfd/family1/a96f6c47c65b48188fd215debfd002da as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/68778c84a159481e8611499288c7f88a_SeqId_47_ 2023-11-20 08:54:58,457 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(849): Loaded HFile hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__f1nkjmgiqiq0h4nl166rgsfbssumuc0oi12l2m5lj2lssqcpr520unrgamokejfd/family1/a96f6c47c65b48188fd215debfd002da into ef901bcc335cc63de4ed78cce9cea920/family1 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/68778c84a159481e8611499288c7f88a_SeqId_47_ - updating store file list. 2023-11-20 08:54:58,460 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(882): Loaded HFile hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/68778c84a159481e8611499288c7f88a_SeqId_47_ into ef901bcc335cc63de4ed78cce9cea920/family1 2023-11-20 08:54:58,460 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(855): Successfully loaded hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__f1nkjmgiqiq0h4nl166rgsfbssumuc0oi12l2m5lj2lssqcpr520unrgamokejfd/family1/a96f6c47c65b48188fd215debfd002da into ef901bcc335cc63de4ed78cce9cea920/family1 (new location: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/68778c84a159481e8611499288c7f88a_SeqId_47_) 2023-11-20 08:54:58,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__f1nkjmgiqiq0h4nl166rgsfbssumuc0oi12l2m5lj2lssqcpr520unrgamokejfd/family1/a96f6c47c65b48188fd215debfd002da 2023-11-20 08:54:58,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-20 08:54:58,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 397422 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-20 08:54:58,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(1912): ef901bcc335cc63de4ed78cce9cea920/family1 is initiating minor compaction (all files) 2023-11-20 08:54:58,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@5af96a1b; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-20 08:54:58,462 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of ef901bcc335cc63de4ed78cce9cea920/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920. 2023-11-20 08:54:58,462 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/c7d1177ef40045acba87c606c9bf16ea, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/5cc702c378014d0bb5d3631b10431ee7, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/68778c84a159481e8611499288c7f88a_SeqId_47_] into tmpdir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/.tmp, totalSize=388.1 K 2023-11-20 08:54:58,462 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting c7d1177ef40045acba87c606c9bf16ea, keycount=1000, bloomtype=ROW, size=190.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878836012 2023-11-20 08:54:58,463 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting 5cc702c378014d0bb5d3631b10431ee7, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621236012 2023-11-20 08:54:58,463 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting 68778c84a159481e8611499288c7f88a_SeqId_47_, keycount=1002, bloomtype=ROW, size=190.9 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878836012 2023-11-20 08:54:58,463 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-20 08:54:58,464 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:54:58,465 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130d71fbec6fca948088451f9849378e94c to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130d71fbec6fca948088451f9849378e94c 2023-11-20 08:54:58,466 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512010ea64d0c37ae47f5b17aa9e96f49ee95 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512010ea64d0c37ae47f5b17aa9e96f49ee95 2023-11-20 08:54:58,467 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205f4b5102e1af04b3fb3b7402aea5d272d to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205f4b5102e1af04b3fb3b7402aea5d272d 2023-11-20 08:54:58,467 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 3 expired mob files are deleted 2023-11-20 08:54:58,467 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-20 08:54:58,468 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-20 08:54:58,468 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-20 08:54:58,468 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-20 08:54:58,469 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=58, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-20 08:54:58,470 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=58, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 1.7980 sec 2023-11-20 08:54:58,476 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] throttle.PressureAwareThroughputController(145): ef901bcc335cc63de4ed78cce9cea920#family1#compaction#73 average throughput is 29.94 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-20 08:54:58,524 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/071442b1e8b643e6976ee66a38be11d8, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/f55b2a16cc49400a91df9389fc90167b, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/794a2101b5ab406fbe14985d7a563b2f, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/0df1a608b9334759a5778c6d1668ae66, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/0fe45ffab7c941c9a5febd1c5ecbc288, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/c5feeb8793944c6f97bfec54e61093e9, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/19b6c10eeb31446a90f3c857fa9b1507, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/a4789a8f15f44f34b33e2f67d11242c7, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/f8179b25928f45f8a709a2ed47ddeab5, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/0ea89b28657d48f1b9f7d01ebc1b4f4e_SeqId_44_] to archive 2023-11-20 08:54:58,524 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:54:58,526 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/071442b1e8b643e6976ee66a38be11d8 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/071442b1e8b643e6976ee66a38be11d8 2023-11-20 08:54:58,527 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/f55b2a16cc49400a91df9389fc90167b to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/f55b2a16cc49400a91df9389fc90167b 2023-11-20 08:54:58,529 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/794a2101b5ab406fbe14985d7a563b2f to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/794a2101b5ab406fbe14985d7a563b2f 2023-11-20 08:54:58,530 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/0df1a608b9334759a5778c6d1668ae66 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/0df1a608b9334759a5778c6d1668ae66 2023-11-20 08:54:58,531 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/0fe45ffab7c941c9a5febd1c5ecbc288 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/0fe45ffab7c941c9a5febd1c5ecbc288 2023-11-20 08:54:58,532 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/c5feeb8793944c6f97bfec54e61093e9 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/c5feeb8793944c6f97bfec54e61093e9 2023-11-20 08:54:58,533 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/19b6c10eeb31446a90f3c857fa9b1507 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/19b6c10eeb31446a90f3c857fa9b1507 2023-11-20 08:54:58,534 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/a4789a8f15f44f34b33e2f67d11242c7 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/a4789a8f15f44f34b33e2f67d11242c7 2023-11-20 08:54:58,535 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/f8179b25928f45f8a709a2ed47ddeab5 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/f8179b25928f45f8a709a2ed47ddeab5 2023-11-20 08:54:58,536 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/0ea89b28657d48f1b9f7d01ebc1b4f4e_SeqId_44_ to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/0ea89b28657d48f1b9f7d01ebc1b4f4e_SeqId_44_ 2023-11-20 08:54:58,538 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-20 08:54:58,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure2.ProcedureExecutor(1028): Stored pid=59, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:54:58,947 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-11-20 08:54:58,948 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-11-20 08:54:58,948 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-11-20 08:54:58,950 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-11-20 08:54:58,952 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=ef901bcc335cc63de4ed78cce9cea920, REOPEN/MOVE}] 2023-11-20 08:54:58,953 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=ef901bcc335cc63de4ed78cce9cea920, REOPEN/MOVE 2023-11-20 08:54:58,953 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=ef901bcc335cc63de4ed78cce9cea920, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:58,954 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700470498953"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700470498953"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700470498953"}]},"ts":"1700470498953"} 2023-11-20 08:54:58,955 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=62, ppid=61, state=RUNNABLE; CloseRegionProcedure ef901bcc335cc63de4ed78cce9cea920, server=jenkins-hbase4.apache.org,38491,1700470412215}] 2023-11-20 08:54:59,106 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:59,107 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ef901bcc335cc63de4ed78cce9cea920 2023-11-20 08:54:59,107 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ef901bcc335cc63de4ed78cce9cea920, disabling compactions & flushes 2023-11-20 08:54:59,107 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920. 2023-11-20 08:54:59,692 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/.tmp/family1/3769a98a9832446a9fa2738650bad741 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/3769a98a9832446a9fa2738650bad741 2023-11-20 08:54:59,696 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in ef901bcc335cc63de4ed78cce9cea920/family1 of ef901bcc335cc63de4ed78cce9cea920 into 3769a98a9832446a9fa2738650bad741(size=192.0 K), total size for store is 192.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-20 08:54:59,696 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for ef901bcc335cc63de4ed78cce9cea920: 2023-11-20 08:54:59,696 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920. 2023-11-20 08:54:59,696 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920. 2023-11-20 08:54:59,696 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920., storeName=family1, fileCount=3, fileSize=388.1 K (190.5 K, 6.8 K, 190.9 K), priority=2, time=1700470498462; duration=1sec 2023-11-20 08:54:59,696 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920. after waiting 0 ms 2023-11-20 08:54:59,696 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920. 2023-11-20 08:54:59,696 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-20 08:54:59,699 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/c7d1177ef40045acba87c606c9bf16ea, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/5cc702c378014d0bb5d3631b10431ee7, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/68778c84a159481e8611499288c7f88a_SeqId_47_] to archive 2023-11-20 08:54:59,700 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:54:59,701 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/c7d1177ef40045acba87c606c9bf16ea to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/c7d1177ef40045acba87c606c9bf16ea 2023-11-20 08:54:59,702 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/5cc702c378014d0bb5d3631b10431ee7 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/5cc702c378014d0bb5d3631b10431ee7 2023-11-20 08:54:59,703 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/68778c84a159481e8611499288c7f88a_SeqId_47_ to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/68778c84a159481e8611499288c7f88a_SeqId_47_ 2023-11-20 08:54:59,707 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-20 08:54:59,708 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920. 2023-11-20 08:54:59,708 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ef901bcc335cc63de4ed78cce9cea920: 2023-11-20 08:54:59,708 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3510): Not adding moved region record: ef901bcc335cc63de4ed78cce9cea920 to self. 2023-11-20 08:54:59,709 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ef901bcc335cc63de4ed78cce9cea920 2023-11-20 08:54:59,709 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=ef901bcc335cc63de4ed78cce9cea920, regionState=CLOSED 2023-11-20 08:54:59,709 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700470499709"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700470499709"}]},"ts":"1700470499709"} 2023-11-20 08:54:59,712 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=62, resume processing ppid=61 2023-11-20 08:54:59,712 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=62, ppid=61, state=SUCCESS; CloseRegionProcedure ef901bcc335cc63de4ed78cce9cea920, server=jenkins-hbase4.apache.org,38491,1700470412215 in 755 msec 2023-11-20 08:54:59,712 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=ef901bcc335cc63de4ed78cce9cea920, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,38491,1700470412215; forceNewPlan=false, retain=true 2023-11-20 08:54:59,863 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=ef901bcc335cc63de4ed78cce9cea920, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:54:59,863 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700470499863"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700470499863"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700470499863"}]},"ts":"1700470499863"} 2023-11-20 08:54:59,864 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=63, ppid=61, state=RUNNABLE; OpenRegionProcedure ef901bcc335cc63de4ed78cce9cea920, server=jenkins-hbase4.apache.org,38491,1700470412215}] 2023-11-20 08:55:00,016 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:00,018 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920. 2023-11-20 08:55:00,018 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ef901bcc335cc63de4ed78cce9cea920, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920.', STARTKEY => '', ENDKEY => ''} 2023-11-20 08:55:00,018 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily ef901bcc335cc63de4ed78cce9cea920 2023-11-20 08:55:00,019 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-20 08:55:00,019 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ef901bcc335cc63de4ed78cce9cea920 2023-11-20 08:55:00,019 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ef901bcc335cc63de4ed78cce9cea920 2023-11-20 08:55:00,020 INFO [StoreOpener-ef901bcc335cc63de4ed78cce9cea920-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region ef901bcc335cc63de4ed78cce9cea920 2023-11-20 08:55:00,020 DEBUG [StoreOpener-ef901bcc335cc63de4ed78cce9cea920-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1 2023-11-20 08:55:00,020 DEBUG [StoreOpener-ef901bcc335cc63de4ed78cce9cea920-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1 2023-11-20 08:55:00,021 INFO [StoreOpener-ef901bcc335cc63de4ed78cce9cea920-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ef901bcc335cc63de4ed78cce9cea920 columnFamilyName family1 2023-11-20 08:55:00,025 DEBUG [StoreOpener-ef901bcc335cc63de4ed78cce9cea920-1] regionserver.HStore(539): loaded hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/3769a98a9832446a9fa2738650bad741 2023-11-20 08:55:00,025 INFO [StoreOpener-ef901bcc335cc63de4ed78cce9cea920-1] regionserver.HStore(310): Store=ef901bcc335cc63de4ed78cce9cea920/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-20 08:55:00,026 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920 2023-11-20 08:55:00,027 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920 2023-11-20 08:55:00,029 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ef901bcc335cc63de4ed78cce9cea920 2023-11-20 08:55:00,030 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ef901bcc335cc63de4ed78cce9cea920; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70388092, jitterRate=0.04886430501937866}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-20 08:55:00,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ef901bcc335cc63de4ed78cce9cea920: 2023-11-20 08:55:00,030 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920., pid=63, masterSystemTime=1700470500015 2023-11-20 08:55:00,031 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920. 2023-11-20 08:55:00,031 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920. 2023-11-20 08:55:00,032 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=ef901bcc335cc63de4ed78cce9cea920, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:00,032 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700470500032"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700470500032"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700470500032"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700470500032"}]},"ts":"1700470500032"} 2023-11-20 08:55:00,034 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=63, resume processing ppid=61 2023-11-20 08:55:00,034 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=63, ppid=61, state=SUCCESS; OpenRegionProcedure ef901bcc335cc63de4ed78cce9cea920, server=jenkins-hbase4.apache.org,38491,1700470412215 in 169 msec 2023-11-20 08:55:00,035 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=60 2023-11-20 08:55:00,035 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=60, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=ef901bcc335cc63de4ed78cce9cea920, REOPEN/MOVE in 1.0820 sec 2023-11-20 08:55:00,037 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=59 2023-11-20 08:55:00,037 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=59, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.0860 sec 2023-11-20 08:55:00,038 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=59, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.4990 sec 2023-11-20 08:55:00,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=59 2023-11-20 08:55:00,040 INFO [Listener at localhost/43513] compactions.TestMobCompactor(278): alter status finished 2023-11-20 08:55:00,041 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=36169] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:55:00,042 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-20 08:55:00,042 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-20 08:55:00,043 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-20 08:55:00,043 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700471100043 2023-11-20 08:55:00,043 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-20 08:55:00,044 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-11-20 08:55:00,044 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-20 08:55:00,045 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] zookeeper.ReadOnlyZKClient(139): Connect 0x1344e9c9 to 127.0.0.1:64635 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-20 08:55:00,050 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5d6341e8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-20 08:55:00,050 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-20 08:55:00,050 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-20 08:55:00,050 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-20 08:55:00,050 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-20 08:55:00,050 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-20 08:55:00,874 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128552804ee48af41c88361691db4ce983a to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128552804ee48af41c88361691db4ce983a 2023-11-20 08:55:00,875 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-20 08:55:00,887 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-20 08:55:00,888 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55510, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-20 08:55:00,893 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-20 08:55:00,895 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45674, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-20 08:55:00,902 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/18bdb2e7f83e460e8e83cfe219a2ff4d first=Optional[r05] last=Optional[r8] 2023-11-20 08:55:00,902 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920., hostname=jenkins-hbase4.apache.org,38491,1700470412215, seqNum=51 for row with hfile group [{family1,hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/18bdb2e7f83e460e8e83cfe219a2ff4d}] 2023-11-20 08:55:00,906 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(763): Validating hfile at hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/18bdb2e7f83e460e8e83cfe219a2ff4d for inclusion in ef901bcc335cc63de4ed78cce9cea920/family1 2023-11-20 08:55:00,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-11-20 08:55:00,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(777): Region bounds: first= last= 2023-11-20 08:55:00,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HRegion(2446): Flush status journal for ef901bcc335cc63de4ed78cce9cea920: 2023-11-20 08:55:00,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/18bdb2e7f83e460e8e83cfe219a2ff4d to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__t6asdg3hfaouhfefqatdkutc6hlfoc0pk0f26cjed8dqjt6253fgiqj36j0oskfq/family1/18bdb2e7f83e460e8e83cfe219a2ff4d 2023-11-20 08:55:00,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__t6asdg3hfaouhfefqatdkutc6hlfoc0pk0f26cjed8dqjt6253fgiqj36j0oskfq/family1/18bdb2e7f83e460e8e83cfe219a2ff4d as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/94860f434fe14568a9f56eede756d373_SeqId_53_ 2023-11-20 08:55:00,911 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(849): Loaded HFile hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__t6asdg3hfaouhfefqatdkutc6hlfoc0pk0f26cjed8dqjt6253fgiqj36j0oskfq/family1/18bdb2e7f83e460e8e83cfe219a2ff4d into ef901bcc335cc63de4ed78cce9cea920/family1 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/94860f434fe14568a9f56eede756d373_SeqId_53_ - updating store file list. 2023-11-20 08:55:00,914 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(882): Loaded HFile hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/94860f434fe14568a9f56eede756d373_SeqId_53_ into ef901bcc335cc63de4ed78cce9cea920/family1 2023-11-20 08:55:00,914 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(855): Successfully loaded hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__t6asdg3hfaouhfefqatdkutc6hlfoc0pk0f26cjed8dqjt6253fgiqj36j0oskfq/family1/18bdb2e7f83e460e8e83cfe219a2ff4d into ef901bcc335cc63de4ed78cce9cea920/family1 (new location: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/94860f434fe14568a9f56eede756d373_SeqId_53_) 2023-11-20 08:55:00,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__t6asdg3hfaouhfefqatdkutc6hlfoc0pk0f26cjed8dqjt6253fgiqj36j0oskfq/family1/18bdb2e7f83e460e8e83cfe219a2ff4d 2023-11-20 08:55:00,916 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-20 08:55:00,916 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:55:00,918 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511207822563ea82a44a4b63f6f554a7af64b to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511207822563ea82a44a4b63f6f554a7af64b 2023-11-20 08:55:00,919 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128bcaeb7e28d7846f6aec59edec3265d5f to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128bcaeb7e28d7846f6aec59edec3265d5f 2023-11-20 08:55:00,919 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2 expired mob files are deleted 2023-11-20 08:55:00,919 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-20 08:55:00,919 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-20 08:55:00,919 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-20 08:55:00,919 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-20 08:55:00,919 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-20 08:55:00,919 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-20 08:55:00,920 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-20 08:55:00,921 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 879 msec 2023-11-20 08:55:00,980 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} 2023-11-20 08:55:00,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:55:01,390 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-11-20 08:55:01,391 DEBUG [PEWorker-2] util.FSTableDescriptors(519): Deleted hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-11-20 08:55:01,391 INFO [PEWorker-2] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-11-20 08:55:01,392 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=66, ppid=65, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-11-20 08:55:01,394 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=ef901bcc335cc63de4ed78cce9cea920, REOPEN/MOVE}] 2023-11-20 08:55:01,395 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=ef901bcc335cc63de4ed78cce9cea920, REOPEN/MOVE 2023-11-20 08:55:01,395 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=ef901bcc335cc63de4ed78cce9cea920, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:01,396 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700470501395"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700470501395"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700470501395"}]},"ts":"1700470501395"} 2023-11-20 08:55:01,397 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=68, ppid=67, state=RUNNABLE; CloseRegionProcedure ef901bcc335cc63de4ed78cce9cea920, server=jenkins-hbase4.apache.org,38491,1700470412215}] 2023-11-20 08:55:01,548 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:01,548 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ef901bcc335cc63de4ed78cce9cea920 2023-11-20 08:55:01,549 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ef901bcc335cc63de4ed78cce9cea920, disabling compactions & flushes 2023-11-20 08:55:01,549 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920. 2023-11-20 08:55:01,549 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920. 2023-11-20 08:55:01,549 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920. after waiting 0 ms 2023-11-20 08:55:01,549 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920. 2023-11-20 08:55:01,556 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-11-20 08:55:01,557 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920. 2023-11-20 08:55:01,557 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ef901bcc335cc63de4ed78cce9cea920: 2023-11-20 08:55:01,557 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3510): Not adding moved region record: ef901bcc335cc63de4ed78cce9cea920 to self. 2023-11-20 08:55:01,558 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ef901bcc335cc63de4ed78cce9cea920 2023-11-20 08:55:01,558 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=ef901bcc335cc63de4ed78cce9cea920, regionState=CLOSED 2023-11-20 08:55:01,558 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700470501558"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700470501558"}]},"ts":"1700470501558"} 2023-11-20 08:55:01,560 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=68, resume processing ppid=67 2023-11-20 08:55:01,560 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=67, state=SUCCESS; CloseRegionProcedure ef901bcc335cc63de4ed78cce9cea920, server=jenkins-hbase4.apache.org,38491,1700470412215 in 162 msec 2023-11-20 08:55:01,561 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=ef901bcc335cc63de4ed78cce9cea920, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,38491,1700470412215; forceNewPlan=false, retain=true 2023-11-20 08:55:01,711 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=ef901bcc335cc63de4ed78cce9cea920, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:01,711 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700470501711"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700470501711"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700470501711"}]},"ts":"1700470501711"} 2023-11-20 08:55:01,713 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure ef901bcc335cc63de4ed78cce9cea920, server=jenkins-hbase4.apache.org,38491,1700470412215}] 2023-11-20 08:55:01,864 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:01,867 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920. 2023-11-20 08:55:01,867 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ef901bcc335cc63de4ed78cce9cea920, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920.', STARTKEY => '', ENDKEY => ''} 2023-11-20 08:55:01,867 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily ef901bcc335cc63de4ed78cce9cea920 2023-11-20 08:55:01,867 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-20 08:55:01,867 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ef901bcc335cc63de4ed78cce9cea920 2023-11-20 08:55:01,867 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ef901bcc335cc63de4ed78cce9cea920 2023-11-20 08:55:01,868 INFO [StoreOpener-ef901bcc335cc63de4ed78cce9cea920-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region ef901bcc335cc63de4ed78cce9cea920 2023-11-20 08:55:01,869 DEBUG [StoreOpener-ef901bcc335cc63de4ed78cce9cea920-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1 2023-11-20 08:55:01,869 DEBUG [StoreOpener-ef901bcc335cc63de4ed78cce9cea920-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1 2023-11-20 08:55:01,870 INFO [StoreOpener-ef901bcc335cc63de4ed78cce9cea920-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ef901bcc335cc63de4ed78cce9cea920 columnFamilyName family1 2023-11-20 08:55:01,874 DEBUG [StoreOpener-ef901bcc335cc63de4ed78cce9cea920-1] regionserver.HStore(539): loaded hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/3769a98a9832446a9fa2738650bad741 2023-11-20 08:55:01,877 DEBUG [StoreOpener-ef901bcc335cc63de4ed78cce9cea920-1] regionserver.HStore(539): loaded hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/family1/94860f434fe14568a9f56eede756d373_SeqId_53_ 2023-11-20 08:55:01,877 INFO [StoreOpener-ef901bcc335cc63de4ed78cce9cea920-1] regionserver.HStore(310): Store=ef901bcc335cc63de4ed78cce9cea920/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-20 08:55:01,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920 2023-11-20 08:55:01,879 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920 2023-11-20 08:55:01,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ef901bcc335cc63de4ed78cce9cea920 2023-11-20 08:55:01,882 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ef901bcc335cc63de4ed78cce9cea920; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60796977, jitterRate=-0.0940544456243515}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-20 08:55:01,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ef901bcc335cc63de4ed78cce9cea920: 2023-11-20 08:55:01,882 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920., pid=69, masterSystemTime=1700470501864 2023-11-20 08:55:01,883 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920. 2023-11-20 08:55:01,884 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920. 2023-11-20 08:55:01,884 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=ef901bcc335cc63de4ed78cce9cea920, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:01,884 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700470501884"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700470501884"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700470501884"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700470501884"}]},"ts":"1700470501884"} 2023-11-20 08:55:01,887 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=67 2023-11-20 08:55:01,887 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure ef901bcc335cc63de4ed78cce9cea920, server=jenkins-hbase4.apache.org,38491,1700470412215 in 173 msec 2023-11-20 08:55:01,888 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=67, resume processing ppid=66 2023-11-20 08:55:01,888 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=ef901bcc335cc63de4ed78cce9cea920, REOPEN/MOVE in 493 msec 2023-11-20 08:55:01,890 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=66, resume processing ppid=65 2023-11-20 08:55:01,890 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=66, ppid=65, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 497 msec 2023-11-20 08:55:01,891 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 910 msec 2023-11-20 08:55:01,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=65 2023-11-20 08:55:01,893 INFO [Listener at localhost/43513] compactions.TestMobCompactor(278): alter status finished 2023-11-20 08:55:01,894 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=36169] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-20 08:55:01,895 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] procedure2.ProcedureExecutor(1028): Stored pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-20 08:55:01,896 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-20 08:55:01,896 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-20 08:55:01,896 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=70, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700471101896 2023-11-20 08:55:01,897 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-20 08:55:01,897 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-11-20 08:55:01,897 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-20 08:55:01,899 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] zookeeper.ReadOnlyZKClient(139): Connect 0x357508d1 to 127.0.0.1:64635 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-20 08:55:01,903 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5316be85, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-20 08:55:01,903 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-20 08:55:01,903 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-20 08:55:01,903 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-20 08:55:01,903 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-20 08:55:01,903 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-20 08:55:01,903 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-20 08:55:01,903 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-20 08:55:01,903 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-20 08:55:01,903 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-20 08:55:01,903 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-20 08:55:01,904 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=70, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-20 08:55:01,905 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=70, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 9 msec 2023-11-20 08:55:01,949 INFO [Listener at localhost/43513] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=245 (was 247), OpenFileDescriptor=650 (was 654), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=110 (was 113), ProcessCount=168 (was 168), AvailableMemoryMB=14712 (was 14764) 2023-11-20 08:55:01,959 INFO [Listener at localhost/43513] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=245, OpenFileDescriptor=650, MaxFileDescriptor=60000, SystemLoadAverage=110, ProcessCount=168, AvailableMemoryMB=14711 2023-11-20 08:55:01,962 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-20 08:55:01,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testGetAfterCompaction 2023-11-20 08:55:01,964 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-11-20 08:55:01,964 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testGetAfterCompaction" procId is: 71 2023-11-20 08:55:01,964 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-20 08:55:01,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-20 08:55:01,965 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8 2023-11-20 08:55:01,966 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8 empty. 2023-11-20 08:55:01,966 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8 2023-11-20 08:55:01,966 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-11-20 08:55:02,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-20 08:55:02,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-20 08:55:02,373 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/default/testGetAfterCompaction/.tabledesc/.tableinfo.0000000001 2023-11-20 08:55:02,375 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => 3f197305b6609d4c57b346144423f5a8, NAME => 'testGetAfterCompaction,,1700470501962.3f197305b6609d4c57b346144423f5a8.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp 2023-11-20 08:55:02,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-20 08:55:02,780 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1700470501962.3f197305b6609d4c57b346144423f5a8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-20 08:55:02,780 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1604): Closing 3f197305b6609d4c57b346144423f5a8, disabling compactions & flushes 2023-11-20 08:55:02,780 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1700470501962.3f197305b6609d4c57b346144423f5a8. 2023-11-20 08:55:02,780 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1700470501962.3f197305b6609d4c57b346144423f5a8. 2023-11-20 08:55:02,780 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1700470501962.3f197305b6609d4c57b346144423f5a8. after waiting 0 ms 2023-11-20 08:55:02,780 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1700470501962.3f197305b6609d4c57b346144423f5a8. 2023-11-20 08:55:02,780 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1700470501962.3f197305b6609d4c57b346144423f5a8. 2023-11-20 08:55:02,780 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1558): Region close journal for 3f197305b6609d4c57b346144423f5a8: 2023-11-20 08:55:02,782 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-11-20 08:55:02,783 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1700470501962.3f197305b6609d4c57b346144423f5a8.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1700470502783"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700470502783"}]},"ts":"1700470502783"} 2023-11-20 08:55:02,785 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-20 08:55:02,785 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-20 08:55:02,785 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700470502785"}]},"ts":"1700470502785"} 2023-11-20 08:55:02,786 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLING in hbase:meta 2023-11-20 08:55:02,789 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=3f197305b6609d4c57b346144423f5a8, ASSIGN}] 2023-11-20 08:55:02,791 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=3f197305b6609d4c57b346144423f5a8, ASSIGN 2023-11-20 08:55:02,791 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testGetAfterCompaction, region=3f197305b6609d4c57b346144423f5a8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38491,1700470412215; forceNewPlan=false, retain=false 2023-11-20 08:55:02,942 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=3f197305b6609d4c57b346144423f5a8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:02,942 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1700470501962.3f197305b6609d4c57b346144423f5a8.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1700470502942"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700470502942"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700470502942"}]},"ts":"1700470502942"} 2023-11-20 08:55:02,943 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=73, ppid=72, state=RUNNABLE; OpenRegionProcedure 3f197305b6609d4c57b346144423f5a8, server=jenkins-hbase4.apache.org,38491,1700470412215}] 2023-11-20 08:55:03,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-20 08:55:03,095 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:03,097 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testGetAfterCompaction,,1700470501962.3f197305b6609d4c57b346144423f5a8. 2023-11-20 08:55:03,097 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3f197305b6609d4c57b346144423f5a8, NAME => 'testGetAfterCompaction,,1700470501962.3f197305b6609d4c57b346144423f5a8.', STARTKEY => '', ENDKEY => ''} 2023-11-20 08:55:03,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro with path null and priority 1073741823 2023-11-20 08:55:03,099 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro from HTD of testGetAfterCompaction successfully. 2023-11-20 08:55:03,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testGetAfterCompaction 3f197305b6609d4c57b346144423f5a8 2023-11-20 08:55:03,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1700470501962.3f197305b6609d4c57b346144423f5a8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-20 08:55:03,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3f197305b6609d4c57b346144423f5a8 2023-11-20 08:55:03,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3f197305b6609d4c57b346144423f5a8 2023-11-20 08:55:03,101 INFO [StoreOpener-3f197305b6609d4c57b346144423f5a8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3f197305b6609d4c57b346144423f5a8 2023-11-20 08:55:03,102 DEBUG [StoreOpener-3f197305b6609d4c57b346144423f5a8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1 2023-11-20 08:55:03,102 DEBUG [StoreOpener-3f197305b6609d4c57b346144423f5a8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1 2023-11-20 08:55:03,102 INFO [StoreOpener-3f197305b6609d4c57b346144423f5a8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3f197305b6609d4c57b346144423f5a8 columnFamilyName f1 2023-11-20 08:55:03,103 INFO [StoreOpener-3f197305b6609d4c57b346144423f5a8-1] regionserver.HStore(310): Store=3f197305b6609d4c57b346144423f5a8/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-20 08:55:03,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8 2023-11-20 08:55:03,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8 2023-11-20 08:55:03,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3f197305b6609d4c57b346144423f5a8 2023-11-20 08:55:03,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-20 08:55:03,109 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3f197305b6609d4c57b346144423f5a8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65524232, jitterRate=-0.0236128568649292}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-20 08:55:03,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3f197305b6609d4c57b346144423f5a8: 2023-11-20 08:55:03,109 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testGetAfterCompaction,,1700470501962.3f197305b6609d4c57b346144423f5a8., pid=73, masterSystemTime=1700470503095 2023-11-20 08:55:03,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testGetAfterCompaction,,1700470501962.3f197305b6609d4c57b346144423f5a8. 2023-11-20 08:55:03,111 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testGetAfterCompaction,,1700470501962.3f197305b6609d4c57b346144423f5a8. 2023-11-20 08:55:03,111 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=3f197305b6609d4c57b346144423f5a8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:03,111 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testGetAfterCompaction,,1700470501962.3f197305b6609d4c57b346144423f5a8.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1700470503111"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700470503111"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700470503111"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700470503111"}]},"ts":"1700470503111"} 2023-11-20 08:55:03,113 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=73, resume processing ppid=72 2023-11-20 08:55:03,114 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=72, state=SUCCESS; OpenRegionProcedure 3f197305b6609d4c57b346144423f5a8, server=jenkins-hbase4.apache.org,38491,1700470412215 in 169 msec 2023-11-20 08:55:03,115 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=72, resume processing ppid=71 2023-11-20 08:55:03,115 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=3f197305b6609d4c57b346144423f5a8, ASSIGN in 325 msec 2023-11-20 08:55:03,115 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-20 08:55:03,115 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700470503115"}]},"ts":"1700470503115"} 2023-11-20 08:55:03,116 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLED in hbase:meta 2023-11-20 08:55:03,122 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-11-20 08:55:03,123 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; CreateTableProcedure table=testGetAfterCompaction in 1.1600 sec 2023-11-20 08:55:03,781 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testGetAfterCompaction' 2023-11-20 08:55:04,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-20 08:55:04,069 INFO [Listener at localhost/43513] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testGetAfterCompaction, procId: 71 completed 2023-11-20 08:55:04,069 DEBUG [Listener at localhost/43513] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testGetAfterCompaction get assigned. Timeout = 60000ms 2023-11-20 08:55:04,070 INFO [Listener at localhost/43513] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-11-20 08:55:04,073 INFO [Listener at localhost/43513] hbase.HBaseTestingUtility(3484): All regions for table testGetAfterCompaction assigned to meta. Checking AM states. 2023-11-20 08:55:04,074 INFO [Listener at localhost/43513] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-11-20 08:55:04,074 INFO [Listener at localhost/43513] hbase.HBaseTestingUtility(3504): All regions for table testGetAfterCompaction assigned. 2023-11-20 08:55:04,077 INFO [Listener at localhost/43513] regionserver.HRegion(2745): Flushing 3f197305b6609d4c57b346144423f5a8 1/1 column families, dataSize=37 B heapSize=368 B 2023-11-20 08:55:04,489 INFO [Listener at localhost/43513] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311202c1a62657f12461b9878804413cca164 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202311202c1a62657f12461b9878804413cca164 2023-11-20 08:55:04,894 INFO [Listener at localhost/43513] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/.tmp/f1/46a2d5fef1104f088d6ac483f89d854d 2023-11-20 08:55:04,899 DEBUG [Listener at localhost/43513] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/.tmp/f1/46a2d5fef1104f088d6ac483f89d854d as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/46a2d5fef1104f088d6ac483f89d854d 2023-11-20 08:55:04,903 INFO [Listener at localhost/43513] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/46a2d5fef1104f088d6ac483f89d854d, entries=1, sequenceid=5, filesize=4.9 K 2023-11-20 08:55:04,904 INFO [Listener at localhost/43513] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 3f197305b6609d4c57b346144423f5a8 in 826ms, sequenceid=5, compaction requested=false 2023-11-20 08:55:04,904 DEBUG [Listener at localhost/43513] regionserver.HRegion(2446): Flush status journal for 3f197305b6609d4c57b346144423f5a8: 2023-11-20 08:55:04,906 INFO [Listener at localhost/43513] regionserver.HRegion(2745): Flushing 3f197305b6609d4c57b346144423f5a8 1/1 column families, dataSize=37 B heapSize=368 B 2023-11-20 08:55:05,243 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-20 08:55:05,425 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x357508d1 to 127.0.0.1:64635 2023-11-20 08:55:05,425 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(142): Chore: CompactedHFilesCleaner missed its start time 2023-11-20 08:55:05,425 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-20 08:55:05,426 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-20 08:55:05,426 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1344e9c9 to 127.0.0.1:64635 2023-11-20 08:55:05,426 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-20 08:55:05,426 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-20 08:55:05,426 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3fa9fd61 to 127.0.0.1:64635 2023-11-20 08:55:05,426 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-20 08:55:05,432 INFO [Listener at localhost/43513] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231120c41ac07a8c244df691b2cebe50a18b98 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231120c41ac07a8c244df691b2cebe50a18b98 2023-11-20 08:55:05,838 INFO [Listener at localhost/43513] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/.tmp/f1/2bf6d87672cc4707a9ce88ab28fd6ac5 2023-11-20 08:55:05,842 DEBUG [Listener at localhost/43513] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/.tmp/f1/2bf6d87672cc4707a9ce88ab28fd6ac5 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/2bf6d87672cc4707a9ce88ab28fd6ac5 2023-11-20 08:55:05,845 INFO [Listener at localhost/43513] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/2bf6d87672cc4707a9ce88ab28fd6ac5, entries=1, sequenceid=9, filesize=4.9 K 2023-11-20 08:55:05,846 INFO [Listener at localhost/43513] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 3f197305b6609d4c57b346144423f5a8 in 940ms, sequenceid=9, compaction requested=false 2023-11-20 08:55:05,846 DEBUG [Listener at localhost/43513] regionserver.HRegion(2446): Flush status journal for 3f197305b6609d4c57b346144423f5a8: 2023-11-20 08:55:05,848 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=36169] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testGetAfterCompaction 2023-11-20 08:55:05,849 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] procedure2.ProcedureExecutor(1028): Stored pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-11-20 08:55:05,850 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-11-20 08:55:05,850 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] mob.MobUtils(833): start MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-20 08:55:05,850 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=74, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700471105850 2023-11-20 08:55:05,851 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-20 08:55:05,851 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testGetAfterCompaction' and column 'f1' 2023-11-20 08:55:05,851 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testGetAfterCompaction' column='f1' 2023-11-20 08:55:05,852 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] zookeeper.ReadOnlyZKClient(139): Connect 0x52b525e0 to 127.0.0.1:64635 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-20 08:55:05,857 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@34b14ba5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-20 08:55:05,857 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231120 for table='testGetAfterCompaction' and column='f1' 2023-11-20 08:55:05,899 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/2bf6d87672cc4707a9ce88ab28fd6ac5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700470505838; access_time=1700470504908; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:05,899 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/46a2d5fef1104f088d6ac483f89d854d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700470504894; access_time=1700470504080; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:05,950 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/2bf6d87672cc4707a9ce88ab28fd6ac5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700470505838; access_time=1700470504908; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:05,950 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/46a2d5fef1104f088d6ac483f89d854d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700470504894; access_time=1700470504080; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:06,001 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/2bf6d87672cc4707a9ce88ab28fd6ac5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700470505838; access_time=1700470504908; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:06,001 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/46a2d5fef1104f088d6ac483f89d854d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700470504894; access_time=1700470504080; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:06,051 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/2bf6d87672cc4707a9ce88ab28fd6ac5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700470505838; access_time=1700470504908; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:06,051 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/46a2d5fef1104f088d6ac483f89d854d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700470504894; access_time=1700470504080; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:06,102 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/2bf6d87672cc4707a9ce88ab28fd6ac5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700470505838; access_time=1700470504908; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:06,102 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/46a2d5fef1104f088d6ac483f89d854d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700470504894; access_time=1700470504080; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:06,153 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/2bf6d87672cc4707a9ce88ab28fd6ac5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700470505838; access_time=1700470504908; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:06,153 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/46a2d5fef1104f088d6ac483f89d854d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700470504894; access_time=1700470504080; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:06,203 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/2bf6d87672cc4707a9ce88ab28fd6ac5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700470505838; access_time=1700470504908; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:06,203 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/46a2d5fef1104f088d6ac483f89d854d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700470504894; access_time=1700470504080; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:06,254 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/2bf6d87672cc4707a9ce88ab28fd6ac5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700470505838; access_time=1700470504908; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:06,254 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/46a2d5fef1104f088d6ac483f89d854d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700470504894; access_time=1700470504080; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:06,305 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/2bf6d87672cc4707a9ce88ab28fd6ac5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700470505838; access_time=1700470504908; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:06,305 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/46a2d5fef1104f088d6ac483f89d854d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700470504894; access_time=1700470504080; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:06,355 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/2bf6d87672cc4707a9ce88ab28fd6ac5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700470505838; access_time=1700470504908; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:06,355 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/46a2d5fef1104f088d6ac483f89d854d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700470504894; access_time=1700470504080; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:06,406 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/2bf6d87672cc4707a9ce88ab28fd6ac5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700470505838; access_time=1700470504908; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:06,406 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/46a2d5fef1104f088d6ac483f89d854d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700470504894; access_time=1700470504080; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:06,456 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/2bf6d87672cc4707a9ce88ab28fd6ac5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700470505838; access_time=1700470504908; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:06,457 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/46a2d5fef1104f088d6ac483f89d854d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700470504894; access_time=1700470504080; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:06,507 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/2bf6d87672cc4707a9ce88ab28fd6ac5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700470505838; access_time=1700470504908; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:06,507 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/46a2d5fef1104f088d6ac483f89d854d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700470504894; access_time=1700470504080; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:06,558 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/2bf6d87672cc4707a9ce88ab28fd6ac5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700470505838; access_time=1700470504908; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:06,558 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/46a2d5fef1104f088d6ac483f89d854d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700470504894; access_time=1700470504080; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:06,608 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/2bf6d87672cc4707a9ce88ab28fd6ac5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700470505838; access_time=1700470504908; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:06,608 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/46a2d5fef1104f088d6ac483f89d854d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700470504894; access_time=1700470504080; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:06,659 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/2bf6d87672cc4707a9ce88ab28fd6ac5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700470505838; access_time=1700470504908; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:06,659 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/46a2d5fef1104f088d6ac483f89d854d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700470504894; access_time=1700470504080; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:06,682 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231120bb2f37c299a94575ade29ee2c6a8e880 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231120bb2f37c299a94575ade29ee2c6a8e880 2023-11-20 08:55:06,683 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231120 table='testGetAfterCompaction' column='f1' 2023-11-20 08:55:06,695 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-20 08:55:06,696 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37264, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-20 08:55:06,702 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-20 08:55:06,704 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41074, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-20 08:55:06,711 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/2bf6d87672cc4707a9ce88ab28fd6ac5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700470505838; access_time=1700470504908; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:06,711 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/46a2d5fef1104f088d6ac483f89d854d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700470504894; access_time=1700470504080; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:06,712 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231120/f1/89ed59d9695545ff934b5da1e24a8b6f first=Optional[r1] last=Optional[r2] 2023-11-20 08:55:06,713 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testGetAfterCompaction,,1700470501962.3f197305b6609d4c57b346144423f5a8., hostname=jenkins-hbase4.apache.org,38491,1700470412215, seqNum=2 for row with hfile group [{f1,hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231120/f1/89ed59d9695545ff934b5da1e24a8b6f}] 2023-11-20 08:55:06,717 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(763): Validating hfile at hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231120/f1/89ed59d9695545ff934b5da1e24a8b6f for inclusion in 3f197305b6609d4c57b346144423f5a8/f1 2023-11-20 08:55:06,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-11-20 08:55:06,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(777): Region bounds: first= last= 2023-11-20 08:55:06,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HRegion(2446): Flush status journal for 3f197305b6609d4c57b346144423f5a8: 2023-11-20 08:55:06,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231120/f1/89ed59d9695545ff934b5da1e24a8b6f to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testGetAfterCompaction__nf57efhu8lpnqimbidju0s4tvap3guctu6ppkpjrc2pdbe7q967dkjbaocplh3u2/f1/89ed59d9695545ff934b5da1e24a8b6f 2023-11-20 08:55:06,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testGetAfterCompaction__nf57efhu8lpnqimbidju0s4tvap3guctu6ppkpjrc2pdbe7q967dkjbaocplh3u2/f1/89ed59d9695545ff934b5da1e24a8b6f as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/32ba863d9f134d94bea2ae5f57656b1f_SeqId_12_ 2023-11-20 08:55:06,722 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(849): Loaded HFile hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testGetAfterCompaction__nf57efhu8lpnqimbidju0s4tvap3guctu6ppkpjrc2pdbe7q967dkjbaocplh3u2/f1/89ed59d9695545ff934b5da1e24a8b6f into 3f197305b6609d4c57b346144423f5a8/f1 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/32ba863d9f134d94bea2ae5f57656b1f_SeqId_12_ - updating store file list. 2023-11-20 08:55:06,725 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(882): Loaded HFile hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/32ba863d9f134d94bea2ae5f57656b1f_SeqId_12_ into 3f197305b6609d4c57b346144423f5a8/f1 2023-11-20 08:55:06,725 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(855): Successfully loaded hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testGetAfterCompaction__nf57efhu8lpnqimbidju0s4tvap3guctu6ppkpjrc2pdbe7q967dkjbaocplh3u2/f1/89ed59d9695545ff934b5da1e24a8b6f into 3f197305b6609d4c57b346144423f5a8/f1 (new location: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/32ba863d9f134d94bea2ae5f57656b1f_SeqId_12_) 2023-11-20 08:55:06,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testGetAfterCompaction__nf57efhu8lpnqimbidju0s4tvap3guctu6ppkpjrc2pdbe7q967dkjbaocplh3u2/f1/89ed59d9695545ff934b5da1e24a8b6f 2023-11-20 08:55:06,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(1912): 3f197305b6609d4c57b346144423f5a8/f1 is initiating minor compaction 2023-11-20 08:55:06,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@5eac8df8; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-20 08:55:06,725 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 3f197305b6609d4c57b346144423f5a8/f1 in testGetAfterCompaction,,1700470501962.3f197305b6609d4c57b346144423f5a8. 2023-11-20 08:55:06,726 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/2bf6d87672cc4707a9ce88ab28fd6ac5, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/32ba863d9f134d94bea2ae5f57656b1f_SeqId_12_] into tmpdir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/.tmp, totalSize=10.0 K 2023-11-20 08:55:06,726 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting 2bf6d87672cc4707a9ce88ab28fd6ac5, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-20 08:55:06,726 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting 32ba863d9f134d94bea2ae5f57656b1f_SeqId_12_, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-20 08:55:06,727 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231120 table='testGetAfterCompaction' column='f1' 2023-11-20 08:55:06,728 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:55:06,729 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202311202c1a62657f12461b9878804413cca164 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202311202c1a62657f12461b9878804413cca164 2023-11-20 08:55:06,730 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231120c41ac07a8c244df691b2cebe50a18b98 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231120c41ac07a8c244df691b2cebe50a18b98 2023-11-20 08:55:06,730 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testGetAfterCompaction 2 expired mob files are deleted 2023-11-20 08:55:06,730 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231120' 2023-11-20 08:55:06,731 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231120 for table='testGetAfterCompaction' and column='f1' 2023-11-20 08:55:06,731 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testGetAfterCompaction' column='f1' 2023-11-20 08:55:06,731 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] mob.MobUtils(840): end MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-20 08:55:06,731 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=74, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-11-20 08:55:06,732 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=74, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE in 883 msec 2023-11-20 08:55:06,733 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] throttle.PressureAwareThroughputController(145): 3f197305b6609d4c57b346144423f5a8#f1#compaction#76 average throughput is 0.25 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-20 08:55:06,761 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/2bf6d87672cc4707a9ce88ab28fd6ac5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700470505838; access_time=1700470504908; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:06,761 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/32ba863d9f134d94bea2ae5f57656b1f_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700470506678; access_time=1700470505867; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-20 08:55:06,762 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/46a2d5fef1104f088d6ac483f89d854d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700470504894; access_time=1700470504080; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:06,765 DEBUG [Listener at localhost/43513] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-11-20 08:55:06,768 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37280, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-11-20 08:55:06,769 INFO [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=38491] regionserver.RSRpcServices(1662): Compacting testGetAfterCompaction,,1700470501962.3f197305b6609d4c57b346144423f5a8. 2023-11-20 08:55:06,769 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=38491] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 2 compacting, 0 eligible, 16 blocking 2023-11-20 08:55:06,769 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=38491] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-11-20 08:55:06,769 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=38491] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-11-20 08:55:06,769 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=38491] regionserver.CompactSplit(415): Not compacting testGetAfterCompaction,,1700470501962.3f197305b6609d4c57b346144423f5a8. because compaction request was cancelled 2023-11-20 08:55:06,821 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/2bf6d87672cc4707a9ce88ab28fd6ac5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700470505838; access_time=1700470504908; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:06,821 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/32ba863d9f134d94bea2ae5f57656b1f_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700470506678; access_time=1700470505867; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-20 08:55:06,821 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/46a2d5fef1104f088d6ac483f89d854d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700470504894; access_time=1700470504080; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:06,871 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/2bf6d87672cc4707a9ce88ab28fd6ac5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700470505838; access_time=1700470504908; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:06,872 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/32ba863d9f134d94bea2ae5f57656b1f_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700470506678; access_time=1700470505867; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-20 08:55:06,872 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/46a2d5fef1104f088d6ac483f89d854d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700470504894; access_time=1700470504080; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:06,922 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/2bf6d87672cc4707a9ce88ab28fd6ac5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700470505838; access_time=1700470504908; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:06,922 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/32ba863d9f134d94bea2ae5f57656b1f_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700470506678; access_time=1700470505867; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-20 08:55:06,922 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/46a2d5fef1104f088d6ac483f89d854d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700470504894; access_time=1700470504080; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:06,973 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/2bf6d87672cc4707a9ce88ab28fd6ac5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700470505838; access_time=1700470504908; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:06,973 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/32ba863d9f134d94bea2ae5f57656b1f_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700470506678; access_time=1700470505867; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-20 08:55:06,973 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/46a2d5fef1104f088d6ac483f89d854d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700470504894; access_time=1700470504080; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:07,024 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/2bf6d87672cc4707a9ce88ab28fd6ac5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700470505838; access_time=1700470504908; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:07,024 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/32ba863d9f134d94bea2ae5f57656b1f_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700470506678; access_time=1700470505867; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-20 08:55:07,024 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/46a2d5fef1104f088d6ac483f89d854d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700470504894; access_time=1700470504080; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:07,075 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/2bf6d87672cc4707a9ce88ab28fd6ac5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700470505838; access_time=1700470504908; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:07,075 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/32ba863d9f134d94bea2ae5f57656b1f_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700470506678; access_time=1700470505867; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-20 08:55:07,075 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/46a2d5fef1104f088d6ac483f89d854d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700470504894; access_time=1700470504080; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:07,126 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/2bf6d87672cc4707a9ce88ab28fd6ac5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700470505838; access_time=1700470504908; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:07,126 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/32ba863d9f134d94bea2ae5f57656b1f_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700470506678; access_time=1700470505867; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-20 08:55:07,126 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/46a2d5fef1104f088d6ac483f89d854d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700470504894; access_time=1700470504080; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:07,176 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/2bf6d87672cc4707a9ce88ab28fd6ac5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700470505838; access_time=1700470504908; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:07,177 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/32ba863d9f134d94bea2ae5f57656b1f_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700470506678; access_time=1700470505867; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-20 08:55:07,177 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/46a2d5fef1104f088d6ac483f89d854d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700470504894; access_time=1700470504080; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:07,227 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/2bf6d87672cc4707a9ce88ab28fd6ac5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700470505838; access_time=1700470504908; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:07,227 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/32ba863d9f134d94bea2ae5f57656b1f_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700470506678; access_time=1700470505867; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-20 08:55:07,227 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/46a2d5fef1104f088d6ac483f89d854d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700470504894; access_time=1700470504080; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:07,278 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/2bf6d87672cc4707a9ce88ab28fd6ac5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700470505838; access_time=1700470504908; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:07,278 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/32ba863d9f134d94bea2ae5f57656b1f_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700470506678; access_time=1700470505867; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-20 08:55:07,278 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/46a2d5fef1104f088d6ac483f89d854d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700470504894; access_time=1700470504080; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:07,329 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/2bf6d87672cc4707a9ce88ab28fd6ac5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700470505838; access_time=1700470504908; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:07,329 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/32ba863d9f134d94bea2ae5f57656b1f_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700470506678; access_time=1700470505867; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-20 08:55:07,329 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/46a2d5fef1104f088d6ac483f89d854d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700470504894; access_time=1700470504080; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:07,380 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/2bf6d87672cc4707a9ce88ab28fd6ac5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700470505838; access_time=1700470504908; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:07,380 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/32ba863d9f134d94bea2ae5f57656b1f_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700470506678; access_time=1700470505867; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-20 08:55:07,380 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/46a2d5fef1104f088d6ac483f89d854d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700470504894; access_time=1700470504080; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:07,431 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/2bf6d87672cc4707a9ce88ab28fd6ac5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700470505838; access_time=1700470504908; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:07,431 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/32ba863d9f134d94bea2ae5f57656b1f_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700470506678; access_time=1700470505867; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-20 08:55:07,431 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/46a2d5fef1104f088d6ac483f89d854d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700470504894; access_time=1700470504080; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:07,482 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/2bf6d87672cc4707a9ce88ab28fd6ac5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700470505838; access_time=1700470504908; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:07,482 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/32ba863d9f134d94bea2ae5f57656b1f_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700470506678; access_time=1700470505867; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-20 08:55:07,482 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/46a2d5fef1104f088d6ac483f89d854d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700470504894; access_time=1700470504080; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:07,533 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/2bf6d87672cc4707a9ce88ab28fd6ac5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700470505838; access_time=1700470504908; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:07,533 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/32ba863d9f134d94bea2ae5f57656b1f_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700470506678; access_time=1700470505867; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-20 08:55:07,533 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/46a2d5fef1104f088d6ac483f89d854d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700470504894; access_time=1700470504080; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:07,547 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/.tmp/f1/2560c5bc30ae4232b759e4ef5072ceb8 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/2560c5bc30ae4232b759e4ef5072ceb8 2023-11-20 08:55:07,552 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 2 file(s) in 3f197305b6609d4c57b346144423f5a8/f1 of 3f197305b6609d4c57b346144423f5a8 into 2560c5bc30ae4232b759e4ef5072ceb8(size=5.1 K), total size for store is 10.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-20 08:55:07,552 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 3f197305b6609d4c57b346144423f5a8: 2023-11-20 08:55:07,552 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testGetAfterCompaction,,1700470501962.3f197305b6609d4c57b346144423f5a8., storeName=f1, fileCount=2, fileSize=10.0 K (4.9 K, 5.1 K), priority=2, time=1700470506725; duration=0sec 2023-11-20 08:55:07,552 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-20 08:55:07,584 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/2560c5bc30ae4232b759e4ef5072ceb8; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1700470507541; access_time=1700470506730; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:07,584 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/2bf6d87672cc4707a9ce88ab28fd6ac5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700470505838; access_time=1700470504908; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:07,584 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/32ba863d9f134d94bea2ae5f57656b1f_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700470506678; access_time=1700470505867; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-20 08:55:07,584 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/46a2d5fef1104f088d6ac483f89d854d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700470504894; access_time=1700470504080; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:07,627 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/2bf6d87672cc4707a9ce88ab28fd6ac5, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/32ba863d9f134d94bea2ae5f57656b1f_SeqId_12_] to archive 2023-11-20 08:55:07,628 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:55:07,630 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/2bf6d87672cc4707a9ce88ab28fd6ac5 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/2bf6d87672cc4707a9ce88ab28fd6ac5 2023-11-20 08:55:07,631 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/32ba863d9f134d94bea2ae5f57656b1f_SeqId_12_ to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/32ba863d9f134d94bea2ae5f57656b1f_SeqId_12_ 2023-11-20 08:55:07,634 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/2560c5bc30ae4232b759e4ef5072ceb8; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1700470507541; access_time=1700470506730; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:07,634 INFO [Listener at localhost/43513] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/46a2d5fef1104f088d6ac483f89d854d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700470504894; access_time=1700470504080; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-20 08:55:07,755 INFO [Listener at localhost/43513] client.HBaseAdmin$15(890): Started disable of testGetAfterCompaction 2023-11-20 08:55:07,761 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testGetAfterCompaction 2023-11-20 08:55:07,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36169] procedure2.ProcedureExecutor(1028): Stored pid=75, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testGetAfterCompaction 2023-11-20 08:55:07,771 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700470507771"}]},"ts":"1700470507771"} 2023-11-20 08:55:07,773 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLING in hbase:meta 2023-11-20 08:55:07,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-11-20 08:55:07,775 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testGetAfterCompaction to state=DISABLING 2023-11-20 08:55:07,777 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=3f197305b6609d4c57b346144423f5a8, UNASSIGN}] 2023-11-20 08:55:07,778 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=3f197305b6609d4c57b346144423f5a8, UNASSIGN 2023-11-20 08:55:07,779 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=3f197305b6609d4c57b346144423f5a8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:07,779 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1700470501962.3f197305b6609d4c57b346144423f5a8.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1700470507779"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700470507779"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700470507779"}]},"ts":"1700470507779"} 2023-11-20 08:55:07,781 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; CloseRegionProcedure 3f197305b6609d4c57b346144423f5a8, server=jenkins-hbase4.apache.org,38491,1700470412215}] 2023-11-20 08:55:07,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-11-20 08:55:07,932 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:07,933 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 3f197305b6609d4c57b346144423f5a8 2023-11-20 08:55:07,933 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3f197305b6609d4c57b346144423f5a8, disabling compactions & flushes 2023-11-20 08:55:07,933 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1700470501962.3f197305b6609d4c57b346144423f5a8. 2023-11-20 08:55:07,933 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1700470501962.3f197305b6609d4c57b346144423f5a8. 2023-11-20 08:55:07,933 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1700470501962.3f197305b6609d4c57b346144423f5a8. after waiting 0 ms 2023-11-20 08:55:07,933 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1700470501962.3f197305b6609d4c57b346144423f5a8. 2023-11-20 08:55:07,940 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-11-20 08:55:07,940 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-11-20 08:55:07,941 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1700470501962.3f197305b6609d4c57b346144423f5a8. 2023-11-20 08:55:07,941 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3f197305b6609d4c57b346144423f5a8: 2023-11-20 08:55:07,943 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 3f197305b6609d4c57b346144423f5a8 2023-11-20 08:55:07,943 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=3f197305b6609d4c57b346144423f5a8, regionState=CLOSED 2023-11-20 08:55:07,943 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1700470501962.3f197305b6609d4c57b346144423f5a8.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1700470507943"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700470507943"}]},"ts":"1700470507943"} 2023-11-20 08:55:07,946 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-11-20 08:55:07,946 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; CloseRegionProcedure 3f197305b6609d4c57b346144423f5a8, server=jenkins-hbase4.apache.org,38491,1700470412215 in 164 msec 2023-11-20 08:55:07,947 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=75 2023-11-20 08:55:07,947 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=75, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=3f197305b6609d4c57b346144423f5a8, UNASSIGN in 169 msec 2023-11-20 08:55:07,948 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700470507948"}]},"ts":"1700470507948"} 2023-11-20 08:55:07,949 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLED in hbase:meta 2023-11-20 08:55:07,951 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testGetAfterCompaction to state=DISABLED 2023-11-20 08:55:07,953 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=75, state=SUCCESS; DisableTableProcedure table=testGetAfterCompaction in 189 msec 2023-11-20 08:55:08,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-11-20 08:55:08,075 INFO [Listener at localhost/43513] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testGetAfterCompaction, procId: 75 completed 2023-11-20 08:55:08,080 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testGetAfterCompaction 2023-11-20 08:55:08,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testGetAfterCompaction 2023-11-20 08:55:08,090 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-20 08:55:08,092 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=78, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-20 08:55:08,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=78 2023-11-20 08:55:08,095 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8 2023-11-20 08:55:08,097 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1, FileablePath, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/recovered.edits] 2023-11-20 08:55:08,101 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/2560c5bc30ae4232b759e4ef5072ceb8 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/2560c5bc30ae4232b759e4ef5072ceb8 2023-11-20 08:55:08,102 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/46a2d5fef1104f088d6ac483f89d854d to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/f1/46a2d5fef1104f088d6ac483f89d854d 2023-11-20 08:55:08,105 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/recovered.edits/15.seqid to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8/recovered.edits/15.seqid 2023-11-20 08:55:08,105 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/default/testGetAfterCompaction/3f197305b6609d4c57b346144423f5a8 2023-11-20 08:55:08,105 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-11-20 08:55:08,106 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-11-20 08:55:08,107 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1] 2023-11-20 08:55:08,110 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231120bb2f37c299a94575ade29ee2c6a8e880 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231120bb2f37c299a94575ade29ee2c6a8e880 2023-11-20 08:55:08,110 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-11-20 08:55:08,112 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=78, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-20 08:55:08,138 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testGetAfterCompaction from hbase:meta 2023-11-20 08:55:08,140 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testGetAfterCompaction' descriptor. 2023-11-20 08:55:08,142 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=78, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-20 08:55:08,142 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testGetAfterCompaction' from region states. 2023-11-20 08:55:08,142 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction,,1700470501962.3f197305b6609d4c57b346144423f5a8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1700470508142"}]},"ts":"9223372036854775807"} 2023-11-20 08:55:08,143 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-11-20 08:55:08,144 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 3f197305b6609d4c57b346144423f5a8, NAME => 'testGetAfterCompaction,,1700470501962.3f197305b6609d4c57b346144423f5a8.', STARTKEY => '', ENDKEY => ''}] 2023-11-20 08:55:08,144 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testGetAfterCompaction' as deleted. 2023-11-20 08:55:08,144 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1700470508144"}]},"ts":"9223372036854775807"} 2023-11-20 08:55:08,146 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testGetAfterCompaction state from META 2023-11-20 08:55:08,148 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=78, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-20 08:55:08,149 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; DeleteTableProcedure table=testGetAfterCompaction in 66 msec 2023-11-20 08:55:08,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=78 2023-11-20 08:55:08,194 INFO [Listener at localhost/43513] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testGetAfterCompaction, procId: 78 completed 2023-11-20 08:55:08,206 INFO [Listener at localhost/43513] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=239 (was 245), OpenFileDescriptor=624 (was 650), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=101 (was 110), ProcessCount=168 (was 168), AvailableMemoryMB=14659 (was 14711) 2023-11-20 08:55:08,216 INFO [Listener at localhost/43513] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=239, OpenFileDescriptor=624, MaxFileDescriptor=60000, SystemLoadAverage=101, ProcessCount=168, AvailableMemoryMB=14659 2023-11-20 08:55:08,218 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-20 08:55:08,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testCompactionWithHFileLink 2023-11-20 08:55:08,220 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_PRE_OPERATION 2023-11-20 08:55:08,220 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testCompactionWithHFileLink" procId is: 79 2023-11-20 08:55:08,221 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-20 08:55:08,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-20 08:55:08,223 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd 2023-11-20 08:55:08,223 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7 2023-11-20 08:55:08,223 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903 2023-11-20 08:55:08,223 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd empty. 2023-11-20 08:55:08,223 DEBUG [HFileArchiver-14] backup.HFileArchiver(153): Directory hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7 empty. 2023-11-20 08:55:08,223 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903 empty. 2023-11-20 08:55:08,223 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd 2023-11-20 08:55:08,223 DEBUG [HFileArchiver-14] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7 2023-11-20 08:55:08,224 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903 2023-11-20 08:55:08,224 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testCompactionWithHFileLink regions 2023-11-20 08:55:08,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-20 08:55:08,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-20 08:55:08,634 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-11-20 08:55:08,636 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(7675): creating {ENCODED => 85ad044c09ac7e7f46d086f5a2df28bd, NAME => 'testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp 2023-11-20 08:55:08,636 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(7675): creating {ENCODED => 3c896a09e2b9659e521fbfa3f4c3a8b7, NAME => 'testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp 2023-11-20 08:55:08,636 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(7675): creating {ENCODED => c417fce1816d885109d4ed56f4041903, NAME => 'testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp 2023-11-20 08:55:08,664 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-20 08:55:08,664 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1604): Closing 85ad044c09ac7e7f46d086f5a2df28bd, disabling compactions & flushes 2023-11-20 08:55:08,664 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd. 2023-11-20 08:55:08,665 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd. 2023-11-20 08:55:08,665 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd. after waiting 0 ms 2023-11-20 08:55:08,665 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd. 2023-11-20 08:55:08,665 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd. 2023-11-20 08:55:08,665 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1558): Region close journal for 85ad044c09ac7e7f46d086f5a2df28bd: 2023-11-20 08:55:08,668 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-20 08:55:08,668 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1604): Closing c417fce1816d885109d4ed56f4041903, disabling compactions & flushes 2023-11-20 08:55:08,668 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903. 2023-11-20 08:55:08,668 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903. 2023-11-20 08:55:08,668 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903. after waiting 0 ms 2023-11-20 08:55:08,669 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903. 2023-11-20 08:55:08,669 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903. 2023-11-20 08:55:08,669 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1558): Region close journal for c417fce1816d885109d4ed56f4041903: 2023-11-20 08:55:08,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-20 08:55:09,066 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-20 08:55:09,066 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1604): Closing 3c896a09e2b9659e521fbfa3f4c3a8b7, disabling compactions & flushes 2023-11-20 08:55:09,066 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7. 2023-11-20 08:55:09,066 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7. 2023-11-20 08:55:09,066 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7. after waiting 0 ms 2023-11-20 08:55:09,066 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7. 2023-11-20 08:55:09,066 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7. 2023-11-20 08:55:09,066 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1558): Region close journal for 3c896a09e2b9659e521fbfa3f4c3a8b7: 2023-11-20 08:55:09,068 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ADD_TO_META 2023-11-20 08:55:09,069 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700470509069"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700470509069"}]},"ts":"1700470509069"} 2023-11-20 08:55:09,069 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700470509069"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700470509069"}]},"ts":"1700470509069"} 2023-11-20 08:55:09,069 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700470509069"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700470509069"}]},"ts":"1700470509069"} 2023-11-20 08:55:09,071 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-20 08:55:09,072 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-20 08:55:09,072 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700470509072"}]},"ts":"1700470509072"} 2023-11-20 08:55:09,073 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-11-20 08:55:09,079 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=85ad044c09ac7e7f46d086f5a2df28bd, ASSIGN}, {pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=3c896a09e2b9659e521fbfa3f4c3a8b7, ASSIGN}, {pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c417fce1816d885109d4ed56f4041903, ASSIGN}] 2023-11-20 08:55:09,080 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=3c896a09e2b9659e521fbfa3f4c3a8b7, ASSIGN 2023-11-20 08:55:09,080 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=85ad044c09ac7e7f46d086f5a2df28bd, ASSIGN 2023-11-20 08:55:09,080 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c417fce1816d885109d4ed56f4041903, ASSIGN 2023-11-20 08:55:09,080 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=85ad044c09ac7e7f46d086f5a2df28bd, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38491,1700470412215; forceNewPlan=false, retain=false 2023-11-20 08:55:09,080 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=3c896a09e2b9659e521fbfa3f4c3a8b7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38491,1700470412215; forceNewPlan=false, retain=false 2023-11-20 08:55:09,081 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c417fce1816d885109d4ed56f4041903, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38491,1700470412215; forceNewPlan=false, retain=false 2023-11-20 08:55:09,232 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=85ad044c09ac7e7f46d086f5a2df28bd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:09,232 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=c417fce1816d885109d4ed56f4041903, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:09,232 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=3c896a09e2b9659e521fbfa3f4c3a8b7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:09,232 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700470509232"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700470509232"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700470509232"}]},"ts":"1700470509232"} 2023-11-20 08:55:09,232 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700470509232"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700470509232"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700470509232"}]},"ts":"1700470509232"} 2023-11-20 08:55:09,232 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700470509232"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700470509232"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700470509232"}]},"ts":"1700470509232"} 2023-11-20 08:55:09,234 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=83, ppid=80, state=RUNNABLE; OpenRegionProcedure 85ad044c09ac7e7f46d086f5a2df28bd, server=jenkins-hbase4.apache.org,38491,1700470412215}] 2023-11-20 08:55:09,234 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=84, ppid=82, state=RUNNABLE; OpenRegionProcedure c417fce1816d885109d4ed56f4041903, server=jenkins-hbase4.apache.org,38491,1700470412215}] 2023-11-20 08:55:09,236 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=81, state=RUNNABLE; OpenRegionProcedure 3c896a09e2b9659e521fbfa3f4c3a8b7, server=jenkins-hbase4.apache.org,38491,1700470412215}] 2023-11-20 08:55:09,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-20 08:55:09,386 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:09,389 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903. 2023-11-20 08:55:09,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c417fce1816d885109d4ed56f4041903, NAME => 'testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903.', STARTKEY => '2', ENDKEY => ''} 2023-11-20 08:55:09,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink c417fce1816d885109d4ed56f4041903 2023-11-20 08:55:09,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-20 08:55:09,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c417fce1816d885109d4ed56f4041903 2023-11-20 08:55:09,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c417fce1816d885109d4ed56f4041903 2023-11-20 08:55:09,391 INFO [StoreOpener-c417fce1816d885109d4ed56f4041903-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c417fce1816d885109d4ed56f4041903 2023-11-20 08:55:09,392 DEBUG [StoreOpener-c417fce1816d885109d4ed56f4041903-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1 2023-11-20 08:55:09,392 DEBUG [StoreOpener-c417fce1816d885109d4ed56f4041903-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1 2023-11-20 08:55:09,392 INFO [StoreOpener-c417fce1816d885109d4ed56f4041903-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c417fce1816d885109d4ed56f4041903 columnFamilyName family1 2023-11-20 08:55:09,393 INFO [StoreOpener-c417fce1816d885109d4ed56f4041903-1] regionserver.HStore(310): Store=c417fce1816d885109d4ed56f4041903/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-20 08:55:09,394 INFO [StoreOpener-c417fce1816d885109d4ed56f4041903-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region c417fce1816d885109d4ed56f4041903 2023-11-20 08:55:09,395 DEBUG [StoreOpener-c417fce1816d885109d4ed56f4041903-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family2 2023-11-20 08:55:09,395 DEBUG [StoreOpener-c417fce1816d885109d4ed56f4041903-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family2 2023-11-20 08:55:09,395 INFO [StoreOpener-c417fce1816d885109d4ed56f4041903-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c417fce1816d885109d4ed56f4041903 columnFamilyName family2 2023-11-20 08:55:09,396 INFO [StoreOpener-c417fce1816d885109d4ed56f4041903-1] regionserver.HStore(310): Store=c417fce1816d885109d4ed56f4041903/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-20 08:55:09,397 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903 2023-11-20 08:55:09,397 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903 2023-11-20 08:55:09,399 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-20 08:55:09,400 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c417fce1816d885109d4ed56f4041903 2023-11-20 08:55:09,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-20 08:55:09,402 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c417fce1816d885109d4ed56f4041903; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60600346, jitterRate=-0.09698447585105896}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-20 08:55:09,402 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c417fce1816d885109d4ed56f4041903: 2023-11-20 08:55:09,402 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903., pid=84, masterSystemTime=1700470509386 2023-11-20 08:55:09,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903. 2023-11-20 08:55:09,404 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903. 2023-11-20 08:55:09,404 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7. 2023-11-20 08:55:09,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3c896a09e2b9659e521fbfa3f4c3a8b7, NAME => 'testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7.', STARTKEY => '1', ENDKEY => '2'} 2023-11-20 08:55:09,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 3c896a09e2b9659e521fbfa3f4c3a8b7 2023-11-20 08:55:09,404 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=c417fce1816d885109d4ed56f4041903, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:09,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-20 08:55:09,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3c896a09e2b9659e521fbfa3f4c3a8b7 2023-11-20 08:55:09,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3c896a09e2b9659e521fbfa3f4c3a8b7 2023-11-20 08:55:09,404 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700470509404"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700470509404"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700470509404"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700470509404"}]},"ts":"1700470509404"} 2023-11-20 08:55:09,405 INFO [StoreOpener-3c896a09e2b9659e521fbfa3f4c3a8b7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 3c896a09e2b9659e521fbfa3f4c3a8b7 2023-11-20 08:55:09,407 DEBUG [StoreOpener-3c896a09e2b9659e521fbfa3f4c3a8b7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1 2023-11-20 08:55:09,407 DEBUG [StoreOpener-3c896a09e2b9659e521fbfa3f4c3a8b7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1 2023-11-20 08:55:09,407 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=84, resume processing ppid=82 2023-11-20 08:55:09,407 INFO [StoreOpener-3c896a09e2b9659e521fbfa3f4c3a8b7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3c896a09e2b9659e521fbfa3f4c3a8b7 columnFamilyName family1 2023-11-20 08:55:09,407 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=84, ppid=82, state=SUCCESS; OpenRegionProcedure c417fce1816d885109d4ed56f4041903, server=jenkins-hbase4.apache.org,38491,1700470412215 in 172 msec 2023-11-20 08:55:09,408 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c417fce1816d885109d4ed56f4041903, ASSIGN in 328 msec 2023-11-20 08:55:09,408 INFO [StoreOpener-3c896a09e2b9659e521fbfa3f4c3a8b7-1] regionserver.HStore(310): Store=3c896a09e2b9659e521fbfa3f4c3a8b7/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-20 08:55:09,408 INFO [StoreOpener-3c896a09e2b9659e521fbfa3f4c3a8b7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 3c896a09e2b9659e521fbfa3f4c3a8b7 2023-11-20 08:55:09,410 DEBUG [StoreOpener-3c896a09e2b9659e521fbfa3f4c3a8b7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family2 2023-11-20 08:55:09,410 DEBUG [StoreOpener-3c896a09e2b9659e521fbfa3f4c3a8b7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family2 2023-11-20 08:55:09,410 INFO [StoreOpener-3c896a09e2b9659e521fbfa3f4c3a8b7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3c896a09e2b9659e521fbfa3f4c3a8b7 columnFamilyName family2 2023-11-20 08:55:09,411 INFO [StoreOpener-3c896a09e2b9659e521fbfa3f4c3a8b7-1] regionserver.HStore(310): Store=3c896a09e2b9659e521fbfa3f4c3a8b7/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-20 08:55:09,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7 2023-11-20 08:55:09,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7 2023-11-20 08:55:09,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-20 08:55:09,415 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3c896a09e2b9659e521fbfa3f4c3a8b7 2023-11-20 08:55:09,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-20 08:55:09,417 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3c896a09e2b9659e521fbfa3f4c3a8b7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64901847, jitterRate=-0.03288711607456207}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-20 08:55:09,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3c896a09e2b9659e521fbfa3f4c3a8b7: 2023-11-20 08:55:09,417 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7., pid=85, masterSystemTime=1700470509386 2023-11-20 08:55:09,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7. 2023-11-20 08:55:09,419 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7. 2023-11-20 08:55:09,419 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd. 2023-11-20 08:55:09,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 85ad044c09ac7e7f46d086f5a2df28bd, NAME => 'testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd.', STARTKEY => '', ENDKEY => '1'} 2023-11-20 08:55:09,419 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=3c896a09e2b9659e521fbfa3f4c3a8b7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:09,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 85ad044c09ac7e7f46d086f5a2df28bd 2023-11-20 08:55:09,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-20 08:55:09,419 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700470509419"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700470509419"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700470509419"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700470509419"}]},"ts":"1700470509419"} 2023-11-20 08:55:09,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 85ad044c09ac7e7f46d086f5a2df28bd 2023-11-20 08:55:09,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 85ad044c09ac7e7f46d086f5a2df28bd 2023-11-20 08:55:09,420 INFO [StoreOpener-85ad044c09ac7e7f46d086f5a2df28bd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 85ad044c09ac7e7f46d086f5a2df28bd 2023-11-20 08:55:09,422 DEBUG [StoreOpener-85ad044c09ac7e7f46d086f5a2df28bd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1 2023-11-20 08:55:09,422 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=85, resume processing ppid=81 2023-11-20 08:55:09,422 DEBUG [StoreOpener-85ad044c09ac7e7f46d086f5a2df28bd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1 2023-11-20 08:55:09,422 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=81, state=SUCCESS; OpenRegionProcedure 3c896a09e2b9659e521fbfa3f4c3a8b7, server=jenkins-hbase4.apache.org,38491,1700470412215 in 185 msec 2023-11-20 08:55:09,422 INFO [StoreOpener-85ad044c09ac7e7f46d086f5a2df28bd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 85ad044c09ac7e7f46d086f5a2df28bd columnFamilyName family1 2023-11-20 08:55:09,423 INFO [StoreOpener-85ad044c09ac7e7f46d086f5a2df28bd-1] regionserver.HStore(310): Store=85ad044c09ac7e7f46d086f5a2df28bd/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-20 08:55:09,423 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=3c896a09e2b9659e521fbfa3f4c3a8b7, ASSIGN in 345 msec 2023-11-20 08:55:09,423 INFO [StoreOpener-85ad044c09ac7e7f46d086f5a2df28bd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 85ad044c09ac7e7f46d086f5a2df28bd 2023-11-20 08:55:09,424 DEBUG [StoreOpener-85ad044c09ac7e7f46d086f5a2df28bd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family2 2023-11-20 08:55:09,424 DEBUG [StoreOpener-85ad044c09ac7e7f46d086f5a2df28bd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family2 2023-11-20 08:55:09,425 INFO [StoreOpener-85ad044c09ac7e7f46d086f5a2df28bd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 85ad044c09ac7e7f46d086f5a2df28bd columnFamilyName family2 2023-11-20 08:55:09,425 INFO [StoreOpener-85ad044c09ac7e7f46d086f5a2df28bd-1] regionserver.HStore(310): Store=85ad044c09ac7e7f46d086f5a2df28bd/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-20 08:55:09,426 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd 2023-11-20 08:55:09,426 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd 2023-11-20 08:55:09,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-20 08:55:09,429 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 85ad044c09ac7e7f46d086f5a2df28bd 2023-11-20 08:55:09,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-20 08:55:09,431 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 85ad044c09ac7e7f46d086f5a2df28bd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64563864, jitterRate=-0.037923455238342285}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-20 08:55:09,431 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 85ad044c09ac7e7f46d086f5a2df28bd: 2023-11-20 08:55:09,431 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd., pid=83, masterSystemTime=1700470509386 2023-11-20 08:55:09,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd. 2023-11-20 08:55:09,433 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd. 2023-11-20 08:55:09,433 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=85ad044c09ac7e7f46d086f5a2df28bd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:09,433 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700470509433"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700470509433"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700470509433"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700470509433"}]},"ts":"1700470509433"} 2023-11-20 08:55:09,435 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=83, resume processing ppid=80 2023-11-20 08:55:09,435 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=83, ppid=80, state=SUCCESS; OpenRegionProcedure 85ad044c09ac7e7f46d086f5a2df28bd, server=jenkins-hbase4.apache.org,38491,1700470412215 in 200 msec 2023-11-20 08:55:09,437 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=80, resume processing ppid=79 2023-11-20 08:55:09,437 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=80, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=85ad044c09ac7e7f46d086f5a2df28bd, ASSIGN in 358 msec 2023-11-20 08:55:09,437 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-20 08:55:09,437 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700470509437"}]},"ts":"1700470509437"} 2023-11-20 08:55:09,438 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-11-20 08:55:09,441 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_POST_OPERATION 2023-11-20 08:55:09,442 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; CreateTableProcedure table=testCompactionWithHFileLink in 1.2230 sec 2023-11-20 08:55:09,782 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-11-20 08:55:10,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-20 08:55:10,326 INFO [Listener at localhost/43513] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testCompactionWithHFileLink, procId: 79 completed 2023-11-20 08:55:10,333 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd. with WAL disabled. Data may be lost in the event of a crash. 2023-11-20 08:55:10,334 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7. with WAL disabled. Data may be lost in the event of a crash. 2023-11-20 08:55:10,335 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903. with WAL disabled. Data may be lost in the event of a crash. 2023-11-20 08:55:10,339 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:55:10,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-20 08:55:10,340 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-20 08:55:10,340 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:55:10,341 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-20 08:55:10,341 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-20 08:55:10,341 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-20 08:55:10,341 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-20 08:55:10,343 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:55:10,343 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:10,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:55:10,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:55:10,343 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:10,343 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:55:10,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-20 08:55:10,344 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-20 08:55:10,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:55:10,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-20 08:55:10,344 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-20 08:55:10,344 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-20 08:55:10,345 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-20 08:55:10,345 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:55:10,345 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-20 08:55:10,345 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd. 2023-11-20 08:55:10,345 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd. started... 2023-11-20 08:55:10,353 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903. 2023-11-20 08:55:10,353 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903. started... 2023-11-20 08:55:10,353 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 85ad044c09ac7e7f46d086f5a2df28bd 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-20 08:55:10,353 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7. 2023-11-20 08:55:10,353 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-20 08:55:10,353 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:55:10,353 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7. started... 2023-11-20 08:55:10,353 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing c417fce1816d885109d4ed56f4041903 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-20 08:55:10,354 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 3c896a09e2b9659e521fbfa3f4c3a8b7 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-20 08:55:10,786 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023112078d310eea24740eba786d4ea973a0f92 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023112078d310eea24740eba786d4ea973a0f92 2023-11-20 08:55:10,790 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231120c8a666d226eb4104ad21c3355768bd45 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231120c8a666d226eb4104ad21c3355768bd45 2023-11-20 08:55:10,793 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231120fa10b641104a46d0b823e14b92103359 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231120fa10b641104a46d0b823e14b92103359 2023-11-20 08:55:11,191 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/.tmp/family1/2bc034df4b214a4f85aa27534763b0da 2023-11-20 08:55:11,195 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/.tmp/family1/c7c38f61302543f6ab8b229d5a17e082 2023-11-20 08:55:11,197 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/.tmp/family1/fa4d45a0dc0d44169e48cf27b5b4a06c 2023-11-20 08:55:11,614 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231120bfaf6d4837ad46e3af28fbb32ac0cb79 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231120bfaf6d4837ad46e3af28fbb32ac0cb79 2023-11-20 08:55:11,614 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023112069b1b21c29ba4a408399e00e6a539d77 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023112069b1b21c29ba4a408399e00e6a539d77 2023-11-20 08:55:11,615 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231120e042cad0e43e40588ac8ebe33e6ee08f to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231120e042cad0e43e40588ac8ebe33e6ee08f 2023-11-20 08:55:12,019 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/.tmp/family2/c58b680b02974ce3a6dfe6eb61247c8a 2023-11-20 08:55:12,019 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/.tmp/family2/49c61ac548624234b02ef1d4611f4e9e 2023-11-20 08:55:12,020 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/.tmp/family2/385ba0396fd141c2869c227cb1738afe 2023-11-20 08:55:12,024 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/.tmp/family1/fa4d45a0dc0d44169e48cf27b5b4a06c as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/fa4d45a0dc0d44169e48cf27b5b4a06c 2023-11-20 08:55:12,024 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/.tmp/family1/2bc034df4b214a4f85aa27534763b0da as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/2bc034df4b214a4f85aa27534763b0da 2023-11-20 08:55:12,024 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/.tmp/family1/c7c38f61302543f6ab8b229d5a17e082 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/c7c38f61302543f6ab8b229d5a17e082 2023-11-20 08:55:12,028 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/fa4d45a0dc0d44169e48cf27b5b4a06c, entries=4, sequenceid=5, filesize=5.4 K 2023-11-20 08:55:12,029 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/.tmp/family2/c58b680b02974ce3a6dfe6eb61247c8a as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family2/c58b680b02974ce3a6dfe6eb61247c8a 2023-11-20 08:55:12,029 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/2bc034df4b214a4f85aa27534763b0da, entries=4, sequenceid=5, filesize=5.4 K 2023-11-20 08:55:12,030 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/c7c38f61302543f6ab8b229d5a17e082, entries=4, sequenceid=5, filesize=5.4 K 2023-11-20 08:55:12,032 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/.tmp/family2/49c61ac548624234b02ef1d4611f4e9e as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family2/49c61ac548624234b02ef1d4611f4e9e 2023-11-20 08:55:12,033 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/.tmp/family2/385ba0396fd141c2869c227cb1738afe as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family2/385ba0396fd141c2869c227cb1738afe 2023-11-20 08:55:12,038 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family2/c58b680b02974ce3a6dfe6eb61247c8a, entries=2, sequenceid=5, filesize=5.1 K 2023-11-20 08:55:12,039 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 3c896a09e2b9659e521fbfa3f4c3a8b7 in 1685ms, sequenceid=5, compaction requested=false 2023-11-20 08:55:12,039 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 3c896a09e2b9659e521fbfa3f4c3a8b7: 2023-11-20 08:55:12,039 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7. 2023-11-20 08:55:12,040 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-20 08:55:12,044 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family2/49c61ac548624234b02ef1d4611f4e9e, entries=2, sequenceid=5, filesize=5.1 K 2023-11-20 08:55:12,045 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 85ad044c09ac7e7f46d086f5a2df28bd in 1692ms, sequenceid=5, compaction requested=false 2023-11-20 08:55:12,045 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 85ad044c09ac7e7f46d086f5a2df28bd: 2023-11-20 08:55:12,045 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd. 2023-11-20 08:55:12,045 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-20 08:55:12,046 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family2/385ba0396fd141c2869c227cb1738afe, entries=2, sequenceid=5, filesize=5.1 K 2023-11-20 08:55:12,047 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for c417fce1816d885109d4ed56f4041903 in 1694ms, sequenceid=5, compaction requested=false 2023-11-20 08:55:12,047 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for c417fce1816d885109d4ed56f4041903: 2023-11-20 08:55:12,047 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903. 2023-11-20 08:55:12,047 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-20 08:55:12,047 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-20 08:55:12,047 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:12,048 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-20 08:55:12,048 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-20 08:55:12,049 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:12,050 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-20 08:55:12,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:12,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:55:12,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:55:12,050 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-20 08:55:12,050 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:55:12,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:55:12,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:55:12,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-20 08:55:12,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:12,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:55:12,052 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-20 08:55:12,052 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@66ea9c13[Count = 0] remaining members to acquire global barrier 2023-11-20 08:55:12,052 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-20 08:55:12,052 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-20 08:55:12,053 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-20 08:55:12,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-20 08:55:12,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-20 08:55:12,053 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-20 08:55:12,053 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-20 08:55:12,053 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:55:12,053 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:12,053 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:55:12,055 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-20 08:55:12,055 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:12,055 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:55:12,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:12,055 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-20 08:55:12,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:55:12,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:55:12,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:55:12,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:55:12,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-20 08:55:12,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:12,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:55:12,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-20 08:55:12,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:12,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:55:12,057 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-20 08:55:12,057 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-20 08:55:12,057 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:55:12,057 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:55:12,057 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-20 08:55:12,057 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:55:12,059 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-20 08:55:12,060 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-20 08:55:12,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-20 08:55:12,060 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:55:12,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:55:12,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:55:12,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-20 08:55:12,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-20 08:55:12,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:55:12,060 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:12,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:55:12,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:55:12,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-20 08:55:12,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-20 08:55:12,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:55:12,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-20 08:55:12,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:12,062 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:12,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:55:12,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-20 08:55:12,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:12,066 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:55:12,066 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:12,066 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-20 08:55:12,066 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:55:12,066 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-20 08:55:12,066 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-20 08:55:12,067 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:12,067 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-20 08:55:12,067 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-20 08:55:12,067 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-20 08:55:12,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:55:12,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:55:12,067 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-20 08:55:12,067 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:55:12,066 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:55:12,066 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:55:12,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:55:12,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:55:12,167 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:55:12,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:55:12,170 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd. with WAL disabled. Data may be lost in the event of a crash. 2023-11-20 08:55:12,170 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7. with WAL disabled. Data may be lost in the event of a crash. 2023-11-20 08:55:12,170 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903. with WAL disabled. Data may be lost in the event of a crash. 2023-11-20 08:55:12,173 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:55:12,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-20 08:55:12,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-20 08:55:12,175 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-20 08:55:12,176 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:55:12,176 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-20 08:55:12,176 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-20 08:55:12,183 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-20 08:55:12,184 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-20 08:55:12,185 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:55:12,185 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:12,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:55:12,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:55:12,186 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:12,186 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:55:12,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-20 08:55:12,186 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-20 08:55:12,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:55:12,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-20 08:55:12,187 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-20 08:55:12,192 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-20 08:55:12,192 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-20 08:55:12,192 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-20 08:55:12,192 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:55:12,192 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-20 08:55:12,193 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd. 2023-11-20 08:55:12,193 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903. 2023-11-20 08:55:12,193 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7. 2023-11-20 08:55:12,193 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903. started... 2023-11-20 08:55:12,193 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd. started... 2023-11-20 08:55:12,193 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-20 08:55:12,193 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing c417fce1816d885109d4ed56f4041903 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-20 08:55:12,193 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7. started... 2023-11-20 08:55:12,193 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 85ad044c09ac7e7f46d086f5a2df28bd 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-20 08:55:12,193 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 3c896a09e2b9659e521fbfa3f4c3a8b7 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-20 08:55:12,193 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:55:12,213 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231120f6195321ff784ce38b2bddfe7d5789b6 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231120f6195321ff784ce38b2bddfe7d5789b6 2023-11-20 08:55:12,609 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231120f43bf08d68b04c5a9298bb294a99ac9d to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231120f43bf08d68b04c5a9298bb294a99ac9d 2023-11-20 08:55:12,613 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231120b8666ade0d124147b4c3e46c3763ef30 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231120b8666ade0d124147b4c3e46c3763ef30 2023-11-20 08:55:12,617 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/.tmp/family1/1e83151507e6498591a9f13142d5a99a 2023-11-20 08:55:13,014 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/.tmp/family1/e1f18fc59fb04513b77458a0ca57c34c 2023-11-20 08:55:13,018 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/.tmp/family1/ec23d5df0abb4729ad90a33a90eb66c5 2023-11-20 08:55:13,030 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311207db876887b2241a58255cdc12b2629da to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311207db876887b2241a58255cdc12b2629da 2023-11-20 08:55:13,042 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/.tmp/family2/f352ce62aae04c87b30585be76110820 2023-11-20 08:55:13,046 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/.tmp/family1/1e83151507e6498591a9f13142d5a99a as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/1e83151507e6498591a9f13142d5a99a 2023-11-20 08:55:13,050 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/1e83151507e6498591a9f13142d5a99a, entries=4, sequenceid=9, filesize=5.4 K 2023-11-20 08:55:13,051 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/.tmp/family2/f352ce62aae04c87b30585be76110820 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family2/f352ce62aae04c87b30585be76110820 2023-11-20 08:55:13,054 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family2/f352ce62aae04c87b30585be76110820, entries=2, sequenceid=9, filesize=5.1 K 2023-11-20 08:55:13,055 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 3c896a09e2b9659e521fbfa3f4c3a8b7 in 862ms, sequenceid=9, compaction requested=false 2023-11-20 08:55:13,055 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 3c896a09e2b9659e521fbfa3f4c3a8b7: 2023-11-20 08:55:13,055 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7. 2023-11-20 08:55:13,055 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-20 08:55:13,432 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231120c4d22fe067304851ab9264447a9b7e6e to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231120c4d22fe067304851ab9264447a9b7e6e 2023-11-20 08:55:13,433 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231120210fabca21a64a5088b7b4e16b28d5e1 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231120210fabca21a64a5088b7b4e16b28d5e1 2023-11-20 08:55:13,442 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-20 08:55:13,837 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/.tmp/family2/463ef75cff3349cfa57903e3803d583c 2023-11-20 08:55:13,838 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/.tmp/family2/101b13c82a8e45e6aeeecdcf4631c167 2023-11-20 08:55:13,841 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/.tmp/family1/e1f18fc59fb04513b77458a0ca57c34c as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/e1f18fc59fb04513b77458a0ca57c34c 2023-11-20 08:55:13,842 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/.tmp/family1/ec23d5df0abb4729ad90a33a90eb66c5 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/ec23d5df0abb4729ad90a33a90eb66c5 2023-11-20 08:55:13,846 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/e1f18fc59fb04513b77458a0ca57c34c, entries=4, sequenceid=9, filesize=5.4 K 2023-11-20 08:55:13,846 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/ec23d5df0abb4729ad90a33a90eb66c5, entries=4, sequenceid=9, filesize=5.4 K 2023-11-20 08:55:13,846 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/.tmp/family2/463ef75cff3349cfa57903e3803d583c as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family2/463ef75cff3349cfa57903e3803d583c 2023-11-20 08:55:13,847 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/.tmp/family2/101b13c82a8e45e6aeeecdcf4631c167 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family2/101b13c82a8e45e6aeeecdcf4631c167 2023-11-20 08:55:13,850 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family2/463ef75cff3349cfa57903e3803d583c, entries=2, sequenceid=9, filesize=5.1 K 2023-11-20 08:55:13,851 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for c417fce1816d885109d4ed56f4041903 in 1658ms, sequenceid=9, compaction requested=false 2023-11-20 08:55:13,851 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family2/101b13c82a8e45e6aeeecdcf4631c167, entries=2, sequenceid=9, filesize=5.1 K 2023-11-20 08:55:13,851 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for c417fce1816d885109d4ed56f4041903: 2023-11-20 08:55:13,851 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903. 2023-11-20 08:55:13,851 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-20 08:55:13,852 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 85ad044c09ac7e7f46d086f5a2df28bd in 1659ms, sequenceid=9, compaction requested=false 2023-11-20 08:55:13,852 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 85ad044c09ac7e7f46d086f5a2df28bd: 2023-11-20 08:55:13,852 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd. 2023-11-20 08:55:13,852 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-20 08:55:13,852 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-20 08:55:13,852 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:13,852 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-20 08:55:13,852 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-20 08:55:13,858 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:13,858 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-20 08:55:13,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:13,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:55:13,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:55:13,858 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-20 08:55:13,858 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:55:13,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:55:13,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:55:13,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-20 08:55:13,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:13,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:55:13,859 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-20 08:55:13,859 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@c0b36cc[Count = 0] remaining members to acquire global barrier 2023-11-20 08:55:13,859 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-20 08:55:13,860 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-20 08:55:13,861 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-20 08:55:13,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-20 08:55:13,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-20 08:55:13,862 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-20 08:55:13,862 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-20 08:55:13,862 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:55:13,862 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:13,862 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:55:13,863 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-20 08:55:13,863 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:13,863 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:55:13,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:13,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:55:13,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:55:13,863 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-20 08:55:13,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:55:13,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:55:13,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-20 08:55:13,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:13,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:55:13,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-20 08:55:13,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:13,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:55:13,865 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-20 08:55:13,865 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-20 08:55:13,865 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:55:13,865 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:55:13,865 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-20 08:55:13,865 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:55:13,867 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-20 08:55:13,867 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-20 08:55:13,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-20 08:55:13,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:55:13,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:55:13,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-20 08:55:13,867 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:55:13,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-20 08:55:13,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:55:13,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:55:13,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:55:13,868 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:13,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-20 08:55:13,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-20 08:55:13,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:55:13,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-20 08:55:13,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:13,869 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:13,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:55:13,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-20 08:55:13,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:13,872 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:13,872 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:55:13,872 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-20 08:55:13,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:55:13,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:55:13,872 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-20 08:55:13,873 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:55:13,872 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:55:13,872 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-11-20 08:55:13,872 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:55:13,872 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-20 08:55:13,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:55:13,873 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-20 08:55:13,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:55:13,873 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:13,873 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:55:13,873 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-20 08:55:13,873 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-20 08:55:13,873 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-20 08:55:13,973 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:55:13,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:55:13,975 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd. with WAL disabled. Data may be lost in the event of a crash. 2023-11-20 08:55:13,975 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7. with WAL disabled. Data may be lost in the event of a crash. 2023-11-20 08:55:13,975 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903. with WAL disabled. Data may be lost in the event of a crash. 2023-11-20 08:55:13,978 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:55:13,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-20 08:55:13,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-20 08:55:13,979 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-20 08:55:13,979 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:55:13,979 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-20 08:55:13,979 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-20 08:55:13,980 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-20 08:55:13,980 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-20 08:55:13,981 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:55:13,981 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:13,981 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:55:13,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:55:13,981 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:13,981 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:55:13,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-20 08:55:13,982 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-20 08:55:13,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:55:13,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-20 08:55:13,982 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-20 08:55:13,982 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-20 08:55:13,982 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-20 08:55:13,982 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-20 08:55:13,982 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:55:13,982 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-20 08:55:13,983 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd. 2023-11-20 08:55:13,983 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd. started... 2023-11-20 08:55:13,983 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-20 08:55:13,983 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:55:13,983 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7. 2023-11-20 08:55:13,983 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 85ad044c09ac7e7f46d086f5a2df28bd 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-20 08:55:13,983 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7. started... 2023-11-20 08:55:13,983 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903. 2023-11-20 08:55:13,983 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903. started... 2023-11-20 08:55:13,983 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 3c896a09e2b9659e521fbfa3f4c3a8b7 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-20 08:55:13,983 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing c417fce1816d885109d4ed56f4041903 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-20 08:55:14,396 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023112071cf63e3fb3c40b0b53c32617f3340d7 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023112071cf63e3fb3c40b0b53c32617f3340d7 2023-11-20 08:55:14,396 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023112043f1cb2484844d628527c6caeae200f2 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023112043f1cb2484844d628527c6caeae200f2 2023-11-20 08:55:14,402 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231120fcb9f5f048a143efb087851bd58889cb to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231120fcb9f5f048a143efb087851bd58889cb 2023-11-20 08:55:14,806 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/.tmp/family1/1936fbed6edb4fbf92c2a753036428d6 2023-11-20 08:55:14,808 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/.tmp/family1/2a3fabf5d99147039126dbb098f308b8 2023-11-20 08:55:14,809 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/.tmp/family1/cf739c3495224991832bce73e7fff537 2023-11-20 08:55:14,830 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311207f281bbcfb78444ab67947a609b6eb35 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311207f281bbcfb78444ab67947a609b6eb35 2023-11-20 08:55:14,834 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/.tmp/family2/001fcf2941754af8b6f053118436cda2 2023-11-20 08:55:14,838 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/.tmp/family1/2a3fabf5d99147039126dbb098f308b8 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/2a3fabf5d99147039126dbb098f308b8 2023-11-20 08:55:14,841 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/2a3fabf5d99147039126dbb098f308b8, entries=4, sequenceid=13, filesize=5.4 K 2023-11-20 08:55:14,842 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/.tmp/family2/001fcf2941754af8b6f053118436cda2 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family2/001fcf2941754af8b6f053118436cda2 2023-11-20 08:55:14,845 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family2/001fcf2941754af8b6f053118436cda2, entries=2, sequenceid=13, filesize=5.1 K 2023-11-20 08:55:14,846 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 85ad044c09ac7e7f46d086f5a2df28bd in 863ms, sequenceid=13, compaction requested=true 2023-11-20 08:55:14,846 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 85ad044c09ac7e7f46d086f5a2df28bd: 2023-11-20 08:55:14,846 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd. 2023-11-20 08:55:14,846 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-20 08:55:15,225 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023112000f56181a8024486beb01a9b1642cef8 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023112000f56181a8024486beb01a9b1642cef8 2023-11-20 08:55:15,230 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/.tmp/family2/70b789bd0e2740bc862576c291870517 2023-11-20 08:55:15,231 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311209a767d91a1f54c938fe436b7e2d849ea to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311209a767d91a1f54c938fe436b7e2d849ea 2023-11-20 08:55:15,234 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/.tmp/family1/1936fbed6edb4fbf92c2a753036428d6 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/1936fbed6edb4fbf92c2a753036428d6 2023-11-20 08:55:15,238 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/1936fbed6edb4fbf92c2a753036428d6, entries=4, sequenceid=13, filesize=5.4 K 2023-11-20 08:55:15,238 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/.tmp/family2/70b789bd0e2740bc862576c291870517 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family2/70b789bd0e2740bc862576c291870517 2023-11-20 08:55:15,242 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family2/70b789bd0e2740bc862576c291870517, entries=2, sequenceid=13, filesize=5.1 K 2023-11-20 08:55:15,243 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for c417fce1816d885109d4ed56f4041903 in 1260ms, sequenceid=13, compaction requested=true 2023-11-20 08:55:15,243 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for c417fce1816d885109d4ed56f4041903: 2023-11-20 08:55:15,243 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903. 2023-11-20 08:55:15,243 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-20 08:55:15,639 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/.tmp/family2/f06094b14986481ea9ae6a16eeb26f98 2023-11-20 08:55:15,643 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/.tmp/family1/cf739c3495224991832bce73e7fff537 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/cf739c3495224991832bce73e7fff537 2023-11-20 08:55:15,646 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/cf739c3495224991832bce73e7fff537, entries=4, sequenceid=13, filesize=5.4 K 2023-11-20 08:55:15,647 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/.tmp/family2/f06094b14986481ea9ae6a16eeb26f98 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family2/f06094b14986481ea9ae6a16eeb26f98 2023-11-20 08:55:15,650 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family2/f06094b14986481ea9ae6a16eeb26f98, entries=2, sequenceid=13, filesize=5.1 K 2023-11-20 08:55:15,650 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 3c896a09e2b9659e521fbfa3f4c3a8b7 in 1667ms, sequenceid=13, compaction requested=true 2023-11-20 08:55:15,651 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 3c896a09e2b9659e521fbfa3f4c3a8b7: 2023-11-20 08:55:15,651 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7. 2023-11-20 08:55:15,651 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-20 08:55:15,651 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-20 08:55:15,651 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:15,651 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-20 08:55:15,651 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-20 08:55:15,654 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:15,654 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-20 08:55:15,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:15,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:55:15,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:55:15,654 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-20 08:55:15,654 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:55:15,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:55:15,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:55:15,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-20 08:55:15,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:15,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:55:15,655 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-20 08:55:15,656 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@55d8f097[Count = 0] remaining members to acquire global barrier 2023-11-20 08:55:15,656 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-20 08:55:15,656 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-20 08:55:15,657 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-20 08:55:15,657 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-20 08:55:15,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-20 08:55:15,657 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-20 08:55:15,657 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-20 08:55:15,657 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:55:15,657 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:15,657 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:55:15,658 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-20 08:55:15,658 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:55:15,658 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:15,658 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-20 08:55:15,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:15,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:55:15,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:55:15,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:55:15,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:55:15,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-20 08:55:15,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:15,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:55:15,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-20 08:55:15,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:15,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:55:15,661 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-20 08:55:15,661 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-20 08:55:15,661 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:55:15,661 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:55:15,661 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-20 08:55:15,661 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:55:15,663 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-20 08:55:15,663 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-20 08:55:15,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-20 08:55:15,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-20 08:55:15,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:55:15,663 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:55:15,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:55:15,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-20 08:55:15,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:55:15,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:55:15,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:55:15,663 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:15,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-20 08:55:15,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-20 08:55:15,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:55:15,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-20 08:55:15,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:15,664 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:15,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:55:15,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-20 08:55:15,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:15,672 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:15,672 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:55:15,672 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-20 08:55:15,672 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:55:15,672 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-20 08:55:15,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:55:15,672 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:55:15,672 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:55:15,672 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-20 08:55:15,672 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:55:15,672 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:15,672 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-20 08:55:15,673 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-20 08:55:15,673 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-20 08:55:15,672 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:55:15,673 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-20 08:55:15,673 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:55:15,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:55:15,773 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:55:15,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:55:15,774 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd. with WAL disabled. Data may be lost in the event of a crash. 2023-11-20 08:55:15,775 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7. with WAL disabled. Data may be lost in the event of a crash. 2023-11-20 08:55:15,775 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903. with WAL disabled. Data may be lost in the event of a crash. 2023-11-20 08:55:15,777 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:55:15,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-20 08:55:15,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-20 08:55:15,778 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-20 08:55:15,778 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:55:15,778 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-20 08:55:15,778 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-20 08:55:15,779 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-20 08:55:15,779 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-20 08:55:15,780 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:55:15,780 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:15,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:55:15,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:55:15,781 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:15,781 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:55:15,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-20 08:55:15,781 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-20 08:55:15,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:55:15,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-20 08:55:15,781 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-20 08:55:15,781 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-20 08:55:15,782 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-20 08:55:15,782 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-20 08:55:15,782 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:55:15,782 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-20 08:55:15,782 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd. 2023-11-20 08:55:15,782 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903. 2023-11-20 08:55:15,782 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-20 08:55:15,782 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903. started... 2023-11-20 08:55:15,782 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:55:15,782 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7. 2023-11-20 08:55:15,782 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7. started... 2023-11-20 08:55:15,782 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd. started... 2023-11-20 08:55:15,782 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing c417fce1816d885109d4ed56f4041903 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-20 08:55:15,782 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 85ad044c09ac7e7f46d086f5a2df28bd 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-20 08:55:15,782 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 3c896a09e2b9659e521fbfa3f4c3a8b7 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-20 08:55:15,809 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231120c38961dec1a24a4fa49ebbccf556edd5 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231120c38961dec1a24a4fa49ebbccf556edd5 2023-11-20 08:55:15,819 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/.tmp/family1/b350610b1eb2407d9ed82182edee91dc 2023-11-20 08:55:16,208 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311200b72f04ed9dd4745a7416f9fa3f787a3 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311200b72f04ed9dd4745a7416f9fa3f787a3 2023-11-20 08:55:16,209 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231120f7517fe0ca684f6e92feb428804de37b to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231120f7517fe0ca684f6e92feb428804de37b 2023-11-20 08:55:16,231 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231120a5a8a2bbf75e424fab2f9d4ef9f18083 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231120a5a8a2bbf75e424fab2f9d4ef9f18083 2023-11-20 08:55:16,613 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/.tmp/family1/1bda7aa2c54340fdb0f8c892a0fc0cc4 2023-11-20 08:55:16,617 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/.tmp/family1/baa9f3cddff746cda812640b187caf04 2023-11-20 08:55:16,635 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/.tmp/family2/abc8a0d5f47f4a589343d123fceadbce 2023-11-20 08:55:16,639 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/.tmp/family1/b350610b1eb2407d9ed82182edee91dc as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/b350610b1eb2407d9ed82182edee91dc 2023-11-20 08:55:16,642 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/b350610b1eb2407d9ed82182edee91dc, entries=4, sequenceid=17, filesize=5.4 K 2023-11-20 08:55:16,643 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/.tmp/family2/abc8a0d5f47f4a589343d123fceadbce as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family2/abc8a0d5f47f4a589343d123fceadbce 2023-11-20 08:55:16,646 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family2/abc8a0d5f47f4a589343d123fceadbce, entries=2, sequenceid=17, filesize=5.1 K 2023-11-20 08:55:16,646 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 85ad044c09ac7e7f46d086f5a2df28bd in 864ms, sequenceid=17, compaction requested=true 2023-11-20 08:55:16,646 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 85ad044c09ac7e7f46d086f5a2df28bd: 2023-11-20 08:55:16,646 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd. 2023-11-20 08:55:16,646 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-20 08:55:17,029 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231120bbd312ae0aaf4858987955fa95433203 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231120bbd312ae0aaf4858987955fa95433203 2023-11-20 08:55:17,034 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023112018495699c31f408da2e0a6767e48908a to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023112018495699c31f408da2e0a6767e48908a 2023-11-20 08:55:17,433 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/.tmp/family2/a4f7262c26c74982adfa4b452ffa6921 2023-11-20 08:55:17,438 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/.tmp/family1/1bda7aa2c54340fdb0f8c892a0fc0cc4 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/1bda7aa2c54340fdb0f8c892a0fc0cc4 2023-11-20 08:55:17,438 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/.tmp/family2/b21ad80b056243bb82c80545bb922fa9 2023-11-20 08:55:17,442 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/1bda7aa2c54340fdb0f8c892a0fc0cc4, entries=4, sequenceid=17, filesize=5.4 K 2023-11-20 08:55:17,443 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/.tmp/family1/baa9f3cddff746cda812640b187caf04 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/baa9f3cddff746cda812640b187caf04 2023-11-20 08:55:17,443 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/.tmp/family2/a4f7262c26c74982adfa4b452ffa6921 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family2/a4f7262c26c74982adfa4b452ffa6921 2023-11-20 08:55:17,446 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/baa9f3cddff746cda812640b187caf04, entries=4, sequenceid=17, filesize=5.4 K 2023-11-20 08:55:17,447 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family2/a4f7262c26c74982adfa4b452ffa6921, entries=2, sequenceid=17, filesize=5.1 K 2023-11-20 08:55:17,447 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/.tmp/family2/b21ad80b056243bb82c80545bb922fa9 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family2/b21ad80b056243bb82c80545bb922fa9 2023-11-20 08:55:17,448 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for c417fce1816d885109d4ed56f4041903 in 1666ms, sequenceid=17, compaction requested=true 2023-11-20 08:55:17,448 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for c417fce1816d885109d4ed56f4041903: 2023-11-20 08:55:17,448 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903. 2023-11-20 08:55:17,448 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-20 08:55:17,451 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family2/b21ad80b056243bb82c80545bb922fa9, entries=2, sequenceid=17, filesize=5.1 K 2023-11-20 08:55:17,451 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 3c896a09e2b9659e521fbfa3f4c3a8b7 in 1669ms, sequenceid=17, compaction requested=true 2023-11-20 08:55:17,451 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 3c896a09e2b9659e521fbfa3f4c3a8b7: 2023-11-20 08:55:17,451 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7. 2023-11-20 08:55:17,451 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-20 08:55:17,451 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-20 08:55:17,451 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:17,451 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-20 08:55:17,451 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-20 08:55:17,453 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:17,453 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-20 08:55:17,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:17,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:55:17,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:55:17,454 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-20 08:55:17,454 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:55:17,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:55:17,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:55:17,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-20 08:55:17,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:17,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:55:17,455 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-20 08:55:17,455 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5870aa6a[Count = 0] remaining members to acquire global barrier 2023-11-20 08:55:17,455 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-20 08:55:17,455 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-20 08:55:17,457 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-20 08:55:17,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-20 08:55:17,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-20 08:55:17,457 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-20 08:55:17,457 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:17,457 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:55:17,457 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-20 08:55:17,457 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:55:17,459 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-20 08:55:17,459 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:55:17,459 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:17,459 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-20 08:55:17,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:17,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:55:17,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:55:17,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:55:17,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:55:17,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-20 08:55:17,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:17,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:55:17,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-20 08:55:17,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:17,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:55:17,462 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-20 08:55:17,462 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-20 08:55:17,462 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:55:17,462 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:55:17,462 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-20 08:55:17,462 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:55:17,464 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-20 08:55:17,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-20 08:55:17,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:55:17,464 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-20 08:55:17,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:55:17,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-20 08:55:17,464 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:55:17,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-20 08:55:17,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:55:17,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:55:17,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:55:17,464 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:17,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-20 08:55:17,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-20 08:55:17,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:55:17,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-20 08:55:17,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:17,465 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:17,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:55:17,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-20 08:55:17,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:17,468 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:17,468 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-20 08:55:17,468 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-20 08:55:17,468 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:55:17,468 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:17,468 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:55:17,468 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:55:17,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:55:17,468 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-20 08:55:17,468 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:55:17,468 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-20 08:55:17,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:55:17,468 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-20 08:55:17,468 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-20 08:55:17,468 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-20 08:55:17,468 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:55:17,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:55:17,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:55:17,568 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:55:17,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:55:17,581 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb-1700470517570 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-20 08:55:17,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1700470517581 (current time:1700470517581). 2023-11-20 08:55:17,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-11-20 08:55:17,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] zookeeper.ReadOnlyZKClient(139): Connect 0x55408541 to 127.0.0.1:64635 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-20 08:55:17,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@dceabf4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-20 08:55:17,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-20 08:55:17,597 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49208, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-20 08:55:17,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x55408541 to 127.0.0.1:64635 2023-11-20 08:55:17,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-20 08:55:17,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-11-20 08:55:17,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb-1700470517570 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-20 08:55:17,608 WARN [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.hbase-snapshot, current working dir path: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.hbase-snapshot/.tmp/snaptb-1700470517570 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-11-20 08:55:17,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] procedure2.ProcedureExecutor(1028): Stored pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-20 08:55:17,617 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-20 08:55:17,618 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=86, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1700471117618 2023-11-20 08:55:17,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb-1700470517570 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-20 08:55:17,619 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb-1700470517570 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-11-20 08:55:17,620 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=86, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-20 08:55:17,621 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-11-20 08:55:17,621 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=86, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 4 msec 2023-11-20 08:55:17,622 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-11-20 08:55:17,622 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=87, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED; timeout=600000, timestamp=1700471117622 2023-11-20 08:55:17,625 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb-1700470517570 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-11-20 08:55:17,625 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-11-20 08:55:17,725 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-20 08:55:17,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1700470517570 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-20 08:55:17,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1700470517570 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-20 08:55:17,729 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-11-20 08:55:17,929 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-20 08:55:17,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1700470517570 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-20 08:55:17,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1700470517570 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-20 08:55:17,930 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-11-20 08:55:18,030 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb-1700470517570 2023-11-20 08:55:18,031 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb-1700470517570' 2023-11-20 08:55:18,031 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-11-20 08:55:18,031 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb-1700470517570' starting 'acquire' 2023-11-20 08:55:18,031 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb-1700470517570', kicking off acquire phase on members. 2023-11-20 08:55:18,031 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1700470517570 2023-11-20 08:55:18,031 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb-1700470517570 2023-11-20 08:55:18,033 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-11-20 08:55:18,033 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb-1700470517570/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:18,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-11-20 08:55:18,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-11-20 08:55:18,033 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb-1700470517570/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:18,033 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:55:18,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb-1700470517570 2023-11-20 08:55:18,034 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1700470517570 2023-11-20 08:55:18,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-11-20 08:55:18,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb-1700470517570 2023-11-20 08:55:18,034 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb-1700470517570 from table testCompactionWithHFileLink type FLUSH 2023-11-20 08:55:18,036 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb-1700470517570 2023-11-20 08:55:18,037 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb-1700470517570' with timeout 300000ms 2023-11-20 08:55:18,037 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-11-20 08:55:18,037 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb-1700470517570' starting 'acquire' stage 2023-11-20 08:55:18,037 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb-1700470517570' locally acquired 2023-11-20 08:55:18,037 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (snaptb-1700470517570) in zk 2023-11-20 08:55:18,038 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb-1700470517570 2023-11-20 08:55:18,038 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1700470517570/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:18,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb-1700470517570/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:18,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:55:18,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-11-20 08:55:18,039 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1700470517570 2023-11-20 08:55:18,039 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb-1700470517570' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:55:18,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:55:18,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:55:18,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1700470517570 2023-11-20 08:55:18,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:18,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:55:18,041 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'snaptb-1700470517570' on coordinator 2023-11-20 08:55:18,041 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6a48bf73[Count = 0] remaining members to acquire global barrier 2023-11-20 08:55:18,041 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb-1700470517570' starting 'in-barrier' execution. 2023-11-20 08:55:18,041 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb-1700470517570 2023-11-20 08:55:18,042 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1700470517570 2023-11-20 08:55:18,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb-1700470517570 2023-11-20 08:55:18,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb-1700470517570 2023-11-20 08:55:18,042 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb-1700470517570' received 'reached' from coordinator. 2023-11-20 08:55:18,042 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1700470517570/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:18,042 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:55:18,043 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd. 2023-11-20 08:55:18,044 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd. started... 2023-11-20 08:55:18,044 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 85ad044c09ac7e7f46d086f5a2df28bd: 2023-11-20 08:55:18,045 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903. 2023-11-20 08:55:18,045 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903. started... 2023-11-20 08:55:18,045 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-snapshot-pool-1] regionserver.HRegion(2446): Flush status journal for c417fce1816d885109d4ed56f4041903: 2023-11-20 08:55:18,045 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd.' region-info for snapshot=snaptb-1700470517570 2023-11-20 08:55:18,045 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903.' region-info for snapshot=snaptb-1700470517570 2023-11-20 08:55:18,052 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-11-20 08:55:18,052 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-11-20 08:55:18,054 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 3 regions 2023-11-20 08:55:18,054 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7. 2023-11-20 08:55:18,054 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-11-20 08:55:18,054 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7. started... 2023-11-20 08:55:18,054 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-snapshot-pool-2] regionserver.HRegion(2446): Flush status journal for 3c896a09e2b9659e521fbfa3f4c3a8b7: 2023-11-20 08:55:18,054 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7.' region-info for snapshot=snaptb-1700470517570 2023-11-20 08:55:18,054 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-11-20 08:55:18,057 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/c7c38f61302543f6ab8b229d5a17e082, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/e1f18fc59fb04513b77458a0ca57c34c, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/1936fbed6edb4fbf92c2a753036428d6, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/1bda7aa2c54340fdb0f8c892a0fc0cc4] hfiles 2023-11-20 08:55:18,057 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/fa4d45a0dc0d44169e48cf27b5b4a06c, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/1e83151507e6498591a9f13142d5a99a, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/cf739c3495224991832bce73e7fff537, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/baa9f3cddff746cda812640b187caf04] hfiles 2023-11-20 08:55:18,058 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/fa4d45a0dc0d44169e48cf27b5b4a06c for snapshot=snaptb-1700470517570 2023-11-20 08:55:18,057 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/2bc034df4b214a4f85aa27534763b0da, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/ec23d5df0abb4729ad90a33a90eb66c5, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/2a3fabf5d99147039126dbb098f308b8, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/b350610b1eb2407d9ed82182edee91dc] hfiles 2023-11-20 08:55:18,057 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/c7c38f61302543f6ab8b229d5a17e082 for snapshot=snaptb-1700470517570 2023-11-20 08:55:18,058 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/2bc034df4b214a4f85aa27534763b0da for snapshot=snaptb-1700470517570 2023-11-20 08:55:18,061 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/e1f18fc59fb04513b77458a0ca57c34c for snapshot=snaptb-1700470517570 2023-11-20 08:55:18,061 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/ec23d5df0abb4729ad90a33a90eb66c5 for snapshot=snaptb-1700470517570 2023-11-20 08:55:18,061 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/1e83151507e6498591a9f13142d5a99a for snapshot=snaptb-1700470517570 2023-11-20 08:55:18,061 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/2a3fabf5d99147039126dbb098f308b8 for snapshot=snaptb-1700470517570 2023-11-20 08:55:18,061 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/1936fbed6edb4fbf92c2a753036428d6 for snapshot=snaptb-1700470517570 2023-11-20 08:55:18,061 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/b350610b1eb2407d9ed82182edee91dc for snapshot=snaptb-1700470517570 2023-11-20 08:55:18,061 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/cf739c3495224991832bce73e7fff537 for snapshot=snaptb-1700470517570 2023-11-20 08:55:18,061 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/1bda7aa2c54340fdb0f8c892a0fc0cc4 for snapshot=snaptb-1700470517570 2023-11-20 08:55:18,061 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family2/49c61ac548624234b02ef1d4611f4e9e, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family2/101b13c82a8e45e6aeeecdcf4631c167, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family2/001fcf2941754af8b6f053118436cda2, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family2/abc8a0d5f47f4a589343d123fceadbce] hfiles 2023-11-20 08:55:18,061 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family2/385ba0396fd141c2869c227cb1738afe, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family2/463ef75cff3349cfa57903e3803d583c, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family2/70b789bd0e2740bc862576c291870517, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family2/a4f7262c26c74982adfa4b452ffa6921] hfiles 2023-11-20 08:55:18,061 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family2/385ba0396fd141c2869c227cb1738afe for snapshot=snaptb-1700470517570 2023-11-20 08:55:18,061 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family2/463ef75cff3349cfa57903e3803d583c for snapshot=snaptb-1700470517570 2023-11-20 08:55:18,061 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/baa9f3cddff746cda812640b187caf04 for snapshot=snaptb-1700470517570 2023-11-20 08:55:18,061 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family2/70b789bd0e2740bc862576c291870517 for snapshot=snaptb-1700470517570 2023-11-20 08:55:18,062 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family2/c58b680b02974ce3a6dfe6eb61247c8a, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family2/f352ce62aae04c87b30585be76110820, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family2/f06094b14986481ea9ae6a16eeb26f98, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family2/b21ad80b056243bb82c80545bb922fa9] hfiles 2023-11-20 08:55:18,062 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family2/a4f7262c26c74982adfa4b452ffa6921 for snapshot=snaptb-1700470517570 2023-11-20 08:55:18,062 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family2/c58b680b02974ce3a6dfe6eb61247c8a for snapshot=snaptb-1700470517570 2023-11-20 08:55:18,062 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family2/f352ce62aae04c87b30585be76110820 for snapshot=snaptb-1700470517570 2023-11-20 08:55:18,061 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family2/49c61ac548624234b02ef1d4611f4e9e for snapshot=snaptb-1700470517570 2023-11-20 08:55:18,062 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family2/f06094b14986481ea9ae6a16eeb26f98 for snapshot=snaptb-1700470517570 2023-11-20 08:55:18,062 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family2/101b13c82a8e45e6aeeecdcf4631c167 for snapshot=snaptb-1700470517570 2023-11-20 08:55:18,062 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family2/b21ad80b056243bb82c80545bb922fa9 for snapshot=snaptb-1700470517570 2023-11-20 08:55:18,062 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family2/001fcf2941754af8b6f053118436cda2 for snapshot=snaptb-1700470517570 2023-11-20 08:55:18,062 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family2/abc8a0d5f47f4a589343d123fceadbce for snapshot=snaptb-1700470517570 2023-11-20 08:55:18,068 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd. completed. 2023-11-20 08:55:18,068 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd. 2023-11-20 08:55:18,069 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/3 local region snapshots. 2023-11-20 08:55:18,230 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-20 08:55:18,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1700470517570 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-20 08:55:18,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1700470517570 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-20 08:55:18,231 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-11-20 08:55:18,469 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903. completed. 2023-11-20 08:55:18,469 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903. 2023-11-20 08:55:18,469 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/3 local region snapshots. 2023-11-20 08:55:18,469 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7. completed. 2023-11-20 08:55:18,469 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7. 2023-11-20 08:55:18,469 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/3 local region snapshots. 2023-11-20 08:55:18,469 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 3 local region snapshots. 2023-11-20 08:55:18,469 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:18,469 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb-1700470517570' locally completed 2023-11-20 08:55:18,469 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb-1700470517570' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:55:18,471 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb-1700470517570' has notified controller of completion 2023-11-20 08:55:18,471 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1700470517570/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:18,471 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:55:18,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb-1700470517570/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:18,471 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb-1700470517570' completed. 2023-11-20 08:55:18,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:55:18,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-11-20 08:55:18,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:55:18,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:55:18,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1700470517570 2023-11-20 08:55:18,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:18,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:55:18,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1700470517570 2023-11-20 08:55:18,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:18,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb-1700470517570' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:55:18,474 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'snaptb-1700470517570', counting down latch. Waiting for 0 more 2023-11-20 08:55:18,474 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb-1700470517570' execution completed 2023-11-20 08:55:18,474 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:55:18,474 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:55:18,474 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb-1700470517570 2023-11-20 08:55:18,474 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb-1700470517570including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-11-20 08:55:18,475 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1700470517570 2023-11-20 08:55:18,475 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1700470517570 2023-11-20 08:55:18,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb-1700470517570 2023-11-20 08:55:18,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb-1700470517570 2023-11-20 08:55:18,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:55:18,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-11-20 08:55:18,475 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-11-20 08:55:18,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1700470517570 2023-11-20 08:55:18,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:55:18,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-11-20 08:55:18,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-11-20 08:55:18,476 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb-1700470517570/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:18,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1700470517570 2023-11-20 08:55:18,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1700470517570 2023-11-20 08:55:18,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:55:18,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1700470517570 2023-11-20 08:55:18,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:18,477 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb-1700470517570/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:18,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:55:18,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1700470517570 2023-11-20 08:55:18,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:18,480 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1700470517570/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:18,480 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1700470517570 2023-11-20 08:55:18,480 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1700470517570 2023-11-20 08:55:18,480 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1700470517570/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:18,480 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1700470517570 2023-11-20 08:55:18,480 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1700470517570 2023-11-20 08:55:18,480 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1700470517570 2023-11-20 08:55:18,480 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:55:18,480 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-11-20 08:55:18,480 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb-1700470517570 2023-11-20 08:55:18,480 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-11-20 08:55:18,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-11-20 08:55:18,480 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testCompactionWithHFileLink 2023-11-20 08:55:18,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-11-20 08:55:18,480 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 0e7b6fa9e81bd62588edd7d77d6165e4, NAME => 'testCompactionWithHFileLink,.mob,0.0e7b6fa9e81bd62588edd7d77d6165e4.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb-1700470517570 2023-11-20 08:55:18,480 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-11-20 08:55:18,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-11-20 08:55:18,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-11-20 08:55:18,481 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231120f6195321ff784ce38b2bddfe7d5789b6, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231120f7517fe0ca684f6e92feb428804de37b, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231120fa10b641104a46d0b823e14b92103359, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231120fcb9f5f048a143efb087851bd58889cb, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311200b72f04ed9dd4745a7416f9fa3f787a3, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023112043f1cb2484844d628527c6caeae200f2, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231120c8a666d226eb4104ad21c3355768bd45, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231120f43bf08d68b04c5a9298bb294a99ac9d, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023112071cf63e3fb3c40b0b53c32617f3340d7, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023112078d310eea24740eba786d4ea973a0f92, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231120b8666ade0d124147b4c3e46c3763ef30, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231120c38961dec1a24a4fa49ebbccf556edd5] mob files 2023-11-20 08:55:18,482 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231120f6195321ff784ce38b2bddfe7d5789b6 2023-11-20 08:55:18,482 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231120f7517fe0ca684f6e92feb428804de37b 2023-11-20 08:55:18,482 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231120fa10b641104a46d0b823e14b92103359 2023-11-20 08:55:18,482 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231120fcb9f5f048a143efb087851bd58889cb 2023-11-20 08:55:18,482 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311200b72f04ed9dd4745a7416f9fa3f787a3 2023-11-20 08:55:18,482 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023112043f1cb2484844d628527c6caeae200f2 2023-11-20 08:55:18,482 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231120c8a666d226eb4104ad21c3355768bd45 2023-11-20 08:55:18,482 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231120f43bf08d68b04c5a9298bb294a99ac9d 2023-11-20 08:55:18,482 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023112071cf63e3fb3c40b0b53c32617f3340d7 2023-11-20 08:55:18,482 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023112078d310eea24740eba786d4ea973a0f92 2023-11-20 08:55:18,482 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231120b8666ade0d124147b4c3e46c3763ef30 2023-11-20 08:55:18,482 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231120c38961dec1a24a4fa49ebbccf556edd5 2023-11-20 08:55:18,483 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023112018495699c31f408da2e0a6767e48908a, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023112069b1b21c29ba4a408399e00e6a539d77, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311207db876887b2241a58255cdc12b2629da, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311209a767d91a1f54c938fe436b7e2d849ea, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023112000f56181a8024486beb01a9b1642cef8, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231120bbd312ae0aaf4858987955fa95433203, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231120c4d22fe067304851ab9264447a9b7e6e, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231120e042cad0e43e40588ac8ebe33e6ee08f, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231120210fabca21a64a5088b7b4e16b28d5e1, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311207f281bbcfb78444ab67947a609b6eb35, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231120a5a8a2bbf75e424fab2f9d4ef9f18083, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231120bfaf6d4837ad46e3af28fbb32ac0cb79] mob files 2023-11-20 08:55:18,483 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023112018495699c31f408da2e0a6767e48908a 2023-11-20 08:55:18,483 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023112069b1b21c29ba4a408399e00e6a539d77 2023-11-20 08:55:18,483 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311207db876887b2241a58255cdc12b2629da 2023-11-20 08:55:18,483 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311209a767d91a1f54c938fe436b7e2d849ea 2023-11-20 08:55:18,483 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023112000f56181a8024486beb01a9b1642cef8 2023-11-20 08:55:18,483 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231120bbd312ae0aaf4858987955fa95433203 2023-11-20 08:55:18,483 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231120c4d22fe067304851ab9264447a9b7e6e 2023-11-20 08:55:18,483 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231120e042cad0e43e40588ac8ebe33e6ee08f 2023-11-20 08:55:18,483 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231120210fabca21a64a5088b7b4e16b28d5e1 2023-11-20 08:55:18,483 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311207f281bbcfb78444ab67947a609b6eb35 2023-11-20 08:55:18,483 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231120a5a8a2bbf75e424fab2f9d4ef9f18083 2023-11-20 08:55:18,483 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231120bfaf6d4837ad46e3af28fbb32ac0cb79 2023-11-20 08:55:18,731 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-20 08:55:18,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1700470517570 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-20 08:55:18,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1700470517570 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-20 08:55:18,733 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-11-20 08:55:18,888 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb-1700470517570 2023-11-20 08:55:18,890 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.hbase-snapshot/.tmp/snaptb-1700470517570 2023-11-20 08:55:19,332 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.hbase-snapshot/.tmp/snaptb-1700470517570 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.hbase-snapshot/snaptb-1700470517570 2023-11-20 08:55:19,332 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb-1700470517570 of table testCompactionWithHFileLink completed 2023-11-20 08:55:19,332 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.hbase-snapshot/.tmp/snaptb-1700470517570 2023-11-20 08:55:19,333 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.hbase-snapshot/.tmp/snaptb-1700470517570 2023-11-20 08:55:19,333 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb-1700470517570 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1700470517619Completed referencing HFiles for the mob region of table: testCompactionWithHFileLink at 1700470518888 (+1269 ms)Consolidate snapshot: snaptb-1700470517570 at 1700470518888Loading Region manifests for snaptb-1700470517570 at 1700470518888Writing data manifest for snaptb-1700470517570 at 1700470518898 (+10 ms)Verifying snapshot: snaptb-1700470517570 at 1700470519304 (+406 ms)Snapshot snaptb-1700470517570 of table testCompactionWithHFileLink completed at 1700470519332 (+28 ms) 2023-11-20 08:55:19,334 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=87, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-11-20 08:55:19,336 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=87, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED in 1.7140 sec 2023-11-20 08:55:19,733 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-20 08:55:19,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1700470517570 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-20 08:55:19,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb-1700470517570 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-11-20 08:55:19,768 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:55:19,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-20 08:55:19,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-20 08:55:19,770 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-20 08:55:19,770 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:55:19,770 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-20 08:55:19,770 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-20 08:55:19,770 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-20 08:55:19,771 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-20 08:55:19,772 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:55:19,772 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:19,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:55:19,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:55:19,772 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:19,772 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:55:19,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-20 08:55:19,773 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-20 08:55:19,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:55:19,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-20 08:55:19,773 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-20 08:55:19,773 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-20 08:55:19,773 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-20 08:55:19,774 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-20 08:55:19,774 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:55:19,774 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-20 08:55:19,774 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd. 2023-11-20 08:55:19,774 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-20 08:55:19,774 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:55:19,774 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903. 2023-11-20 08:55:19,774 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7. 2023-11-20 08:55:19,774 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903. started... 2023-11-20 08:55:19,774 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd. started... 2023-11-20 08:55:19,774 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7. started... 2023-11-20 08:55:19,774 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing c417fce1816d885109d4ed56f4041903 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-20 08:55:19,774 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 85ad044c09ac7e7f46d086f5a2df28bd 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-20 08:55:19,774 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 3c896a09e2b9659e521fbfa3f4c3a8b7 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-20 08:55:20,226 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/.tmp/family1/5729d73bf359411c96f15f0865f73068 2023-11-20 08:55:20,229 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5729d73bf359411c96f15f0865f73068 2023-11-20 08:55:20,619 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/.tmp/family1/a89945a1f91f466e8a6bd9917d35a470 2023-11-20 08:55:20,619 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/.tmp/family1/5a5e246e8d634a7eabf562a3e635f2cb 2023-11-20 08:55:20,623 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a89945a1f91f466e8a6bd9917d35a470 2023-11-20 08:55:20,623 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5a5e246e8d634a7eabf562a3e635f2cb 2023-11-20 08:55:21,038 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/.tmp/family2/f7c9b13b663e4df5bd91db95e206f5a1 2023-11-20 08:55:21,041 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f7c9b13b663e4df5bd91db95e206f5a1 2023-11-20 08:55:21,042 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/.tmp/family1/a89945a1f91f466e8a6bd9917d35a470 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/a89945a1f91f466e8a6bd9917d35a470 2023-11-20 08:55:21,045 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a89945a1f91f466e8a6bd9917d35a470 2023-11-20 08:55:21,045 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/a89945a1f91f466e8a6bd9917d35a470, entries=3, sequenceid=24, filesize=5.0 K 2023-11-20 08:55:21,046 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/.tmp/family2/f7c9b13b663e4df5bd91db95e206f5a1 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family2/f7c9b13b663e4df5bd91db95e206f5a1 2023-11-20 08:55:21,046 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/.tmp/family2/cd927f66457f463f95bde8b40deccf4f 2023-11-20 08:55:21,049 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f7c9b13b663e4df5bd91db95e206f5a1 2023-11-20 08:55:21,049 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family2/f7c9b13b663e4df5bd91db95e206f5a1, entries=1, sequenceid=24, filesize=5.0 K 2023-11-20 08:55:21,050 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cd927f66457f463f95bde8b40deccf4f 2023-11-20 08:55:21,050 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for c417fce1816d885109d4ed56f4041903 in 1276ms, sequenceid=24, compaction requested=true 2023-11-20 08:55:21,050 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for c417fce1816d885109d4ed56f4041903: 2023-11-20 08:55:21,051 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903. 2023-11-20 08:55:21,051 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-20 08:55:21,051 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/.tmp/family1/5729d73bf359411c96f15f0865f73068 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/5729d73bf359411c96f15f0865f73068 2023-11-20 08:55:21,054 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5729d73bf359411c96f15f0865f73068 2023-11-20 08:55:21,054 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/5729d73bf359411c96f15f0865f73068, entries=3, sequenceid=24, filesize=5.0 K 2023-11-20 08:55:21,054 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/.tmp/family2/cd927f66457f463f95bde8b40deccf4f as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family2/cd927f66457f463f95bde8b40deccf4f 2023-11-20 08:55:21,057 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cd927f66457f463f95bde8b40deccf4f 2023-11-20 08:55:21,057 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family2/cd927f66457f463f95bde8b40deccf4f, entries=1, sequenceid=24, filesize=5.0 K 2023-11-20 08:55:21,058 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 3c896a09e2b9659e521fbfa3f4c3a8b7 in 1284ms, sequenceid=24, compaction requested=true 2023-11-20 08:55:21,058 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 3c896a09e2b9659e521fbfa3f4c3a8b7: 2023-11-20 08:55:21,058 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7. 2023-11-20 08:55:21,058 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-20 08:55:21,439 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/.tmp/family2/f7d2fdf75ae440b1bd94ce7b7c58b8a8 2023-11-20 08:55:21,444 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f7d2fdf75ae440b1bd94ce7b7c58b8a8 2023-11-20 08:55:21,445 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/.tmp/family1/5a5e246e8d634a7eabf562a3e635f2cb as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/5a5e246e8d634a7eabf562a3e635f2cb 2023-11-20 08:55:21,449 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5a5e246e8d634a7eabf562a3e635f2cb 2023-11-20 08:55:21,449 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/5a5e246e8d634a7eabf562a3e635f2cb, entries=3, sequenceid=24, filesize=5.0 K 2023-11-20 08:55:21,450 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/.tmp/family2/f7d2fdf75ae440b1bd94ce7b7c58b8a8 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family2/f7d2fdf75ae440b1bd94ce7b7c58b8a8 2023-11-20 08:55:21,454 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f7d2fdf75ae440b1bd94ce7b7c58b8a8 2023-11-20 08:55:21,454 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family2/f7d2fdf75ae440b1bd94ce7b7c58b8a8, entries=1, sequenceid=24, filesize=5.0 K 2023-11-20 08:55:21,455 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 85ad044c09ac7e7f46d086f5a2df28bd in 1681ms, sequenceid=24, compaction requested=true 2023-11-20 08:55:21,455 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 85ad044c09ac7e7f46d086f5a2df28bd: 2023-11-20 08:55:21,455 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd. 2023-11-20 08:55:21,455 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-20 08:55:21,455 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-20 08:55:21,455 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:21,455 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-20 08:55:21,455 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-20 08:55:21,457 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:21,457 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-20 08:55:21,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:21,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:55:21,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:55:21,458 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-20 08:55:21,458 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:55:21,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:55:21,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:55:21,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-20 08:55:21,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:21,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:55:21,460 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-20 08:55:21,460 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3fa049a0[Count = 0] remaining members to acquire global barrier 2023-11-20 08:55:21,460 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-20 08:55:21,460 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-20 08:55:21,461 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-20 08:55:21,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-20 08:55:21,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-20 08:55:21,461 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-20 08:55:21,461 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-20 08:55:21,461 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:55:21,461 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:21,461 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:55:21,463 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-20 08:55:21,463 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:21,463 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:55:21,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:21,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:55:21,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:55:21,464 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-20 08:55:21,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:55:21,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:55:21,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-20 08:55:21,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:21,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:55:21,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-20 08:55:21,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:21,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:55:21,467 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-20 08:55:21,467 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-20 08:55:21,467 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:55:21,467 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:55:21,467 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-20 08:55:21,467 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:55:21,469 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-20 08:55:21,469 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-20 08:55:21,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-20 08:55:21,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:55:21,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-20 08:55:21,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-20 08:55:21,469 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:55:21,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:55:21,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:55:21,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:55:21,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:55:21,469 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:21,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-20 08:55:21,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-20 08:55:21,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:55:21,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-20 08:55:21,471 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:21,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:21,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:55:21,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-20 08:55:21,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:21,473 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:21,473 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:55:21,473 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-20 08:55:21,473 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:55:21,473 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-20 08:55:21,473 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:55:21,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:55:21,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:55:21,473 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:55:21,473 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-11-20 08:55:21,473 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-20 08:55:21,473 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-20 08:55:21,473 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:55:21,473 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:21,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:55:21,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:55:21,473 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-20 08:55:21,473 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-20 08:55:21,473 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-20 08:55:21,573 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:55:21,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:55:21,574 DEBUG [Listener at localhost/43513] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-20 08:55:21,575 DEBUG [Listener at localhost/43513] regionserver.HStore(1912): 85ad044c09ac7e7f46d086f5a2df28bd/family1 is initiating major compaction (all files) 2023-11-20 08:55:21,575 INFO [Listener at localhost/43513] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-20 08:55:21,575 INFO [Listener at localhost/43513] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-20 08:55:21,575 INFO [Listener at localhost/43513] regionserver.HRegion(2259): Starting compaction of 85ad044c09ac7e7f46d086f5a2df28bd/family1 in testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd. 2023-11-20 08:55:21,575 INFO [Listener at localhost/43513] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/2bc034df4b214a4f85aa27534763b0da, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/ec23d5df0abb4729ad90a33a90eb66c5, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/2a3fabf5d99147039126dbb098f308b8, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/b350610b1eb2407d9ed82182edee91dc, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/5a5e246e8d634a7eabf562a3e635f2cb] into tmpdir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/.tmp, totalSize=26.7 K 2023-11-20 08:55:21,576 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting 2bc034df4b214a4f85aa27534763b0da, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700470510333 2023-11-20 08:55:21,576 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting ec23d5df0abb4729ad90a33a90eb66c5, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700470512170 2023-11-20 08:55:21,576 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting 2a3fabf5d99147039126dbb098f308b8, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700470513975 2023-11-20 08:55:21,577 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting b350610b1eb2407d9ed82182edee91dc, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700470515774 2023-11-20 08:55:21,577 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting 5a5e246e8d634a7eabf562a3e635f2cb, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-20 08:55:21,589 INFO [Listener at localhost/43513] throttle.PressureAwareThroughputController(145): 85ad044c09ac7e7f46d086f5a2df28bd#family1#compaction#107 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-20 08:55:21,996 INFO [Listener at localhost/43513] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202311204fa30d13c1654ead9e0851d8faa2dba7_del 2023-11-20 08:55:21,996 INFO [Listener at localhost/43513] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311204fa30d13c1654ead9e0851d8faa2dba7_del to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311204fa30d13c1654ead9e0851d8faa2dba7_del 2023-11-20 08:55:22,809 INFO [Listener at localhost/43513] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 02380f8ff7534e04bd6489d09f7ff6aa 2023-11-20 08:55:22,810 DEBUG [Listener at localhost/43513] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/.tmp/family1/02380f8ff7534e04bd6489d09f7ff6aa as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/02380f8ff7534e04bd6489d09f7ff6aa 2023-11-20 08:55:22,813 INFO [Listener at localhost/43513] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 02380f8ff7534e04bd6489d09f7ff6aa 2023-11-20 08:55:22,814 INFO [Listener at localhost/43513] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 85ad044c09ac7e7f46d086f5a2df28bd/family1 of 85ad044c09ac7e7f46d086f5a2df28bd into 02380f8ff7534e04bd6489d09f7ff6aa(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-20 08:55:22,814 DEBUG [Listener at localhost/43513] regionserver.HRegion(2289): Compaction status journal for 85ad044c09ac7e7f46d086f5a2df28bd: 2023-11-20 08:55:22,814 DEBUG [Listener at localhost/43513] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-20 08:55:22,814 DEBUG [Listener at localhost/43513] regionserver.HStore(1912): 85ad044c09ac7e7f46d086f5a2df28bd/family2 is initiating major compaction (all files) 2023-11-20 08:55:22,815 INFO [Listener at localhost/43513] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-20 08:55:22,815 INFO [Listener at localhost/43513] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-20 08:55:22,815 INFO [Listener at localhost/43513] regionserver.HRegion(2259): Starting compaction of 85ad044c09ac7e7f46d086f5a2df28bd/family2 in testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd. 2023-11-20 08:55:22,815 INFO [Listener at localhost/43513] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family2/49c61ac548624234b02ef1d4611f4e9e, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family2/101b13c82a8e45e6aeeecdcf4631c167, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family2/001fcf2941754af8b6f053118436cda2, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family2/abc8a0d5f47f4a589343d123fceadbce, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family2/f7d2fdf75ae440b1bd94ce7b7c58b8a8] into tmpdir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/.tmp, totalSize=25.4 K 2023-11-20 08:55:22,815 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting 49c61ac548624234b02ef1d4611f4e9e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700470510333 2023-11-20 08:55:22,816 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting 101b13c82a8e45e6aeeecdcf4631c167, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700470512170 2023-11-20 08:55:22,816 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting 001fcf2941754af8b6f053118436cda2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700470513975 2023-11-20 08:55:22,816 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting abc8a0d5f47f4a589343d123fceadbce, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700470515774 2023-11-20 08:55:22,816 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting f7d2fdf75ae440b1bd94ce7b7c58b8a8, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-20 08:55:22,827 INFO [Listener at localhost/43513] throttle.PressureAwareThroughputController(145): 85ad044c09ac7e7f46d086f5a2df28bd#family2#compaction#108 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-20 08:55:22,827 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/2bc034df4b214a4f85aa27534763b0da, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/ec23d5df0abb4729ad90a33a90eb66c5, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/2a3fabf5d99147039126dbb098f308b8, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/b350610b1eb2407d9ed82182edee91dc, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/5a5e246e8d634a7eabf562a3e635f2cb] to archive 2023-11-20 08:55:22,828 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:55:22,829 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/2bc034df4b214a4f85aa27534763b0da to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/2bc034df4b214a4f85aa27534763b0da 2023-11-20 08:55:22,830 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/ec23d5df0abb4729ad90a33a90eb66c5 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/ec23d5df0abb4729ad90a33a90eb66c5 2023-11-20 08:55:22,831 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/2a3fabf5d99147039126dbb098f308b8 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/2a3fabf5d99147039126dbb098f308b8 2023-11-20 08:55:22,832 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/b350610b1eb2407d9ed82182edee91dc to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/b350610b1eb2407d9ed82182edee91dc 2023-11-20 08:55:22,833 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/5a5e246e8d634a7eabf562a3e635f2cb to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/5a5e246e8d634a7eabf562a3e635f2cb 2023-11-20 08:55:23,237 INFO [Listener at localhost/43513] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202311204814a666a36f4f4e8fe6db88040d84d5_del 2023-11-20 08:55:23,237 INFO [Listener at localhost/43513] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311204814a666a36f4f4e8fe6db88040d84d5_del to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311204814a666a36f4f4e8fe6db88040d84d5_del 2023-11-20 08:55:23,249 INFO [Listener at localhost/43513] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 333b1ec1b6eb46fa8831bea68ceb6588 2023-11-20 08:55:23,250 DEBUG [Listener at localhost/43513] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/.tmp/family2/333b1ec1b6eb46fa8831bea68ceb6588 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family2/333b1ec1b6eb46fa8831bea68ceb6588 2023-11-20 08:55:23,254 INFO [Listener at localhost/43513] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 333b1ec1b6eb46fa8831bea68ceb6588 2023-11-20 08:55:23,254 INFO [Listener at localhost/43513] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 85ad044c09ac7e7f46d086f5a2df28bd/family2 of 85ad044c09ac7e7f46d086f5a2df28bd into 333b1ec1b6eb46fa8831bea68ceb6588(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-20 08:55:23,254 DEBUG [Listener at localhost/43513] regionserver.HRegion(2289): Compaction status journal for 85ad044c09ac7e7f46d086f5a2df28bd: 2023-11-20 08:55:23,255 DEBUG [Listener at localhost/43513] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-20 08:55:23,255 DEBUG [Listener at localhost/43513] regionserver.HStore(1912): c417fce1816d885109d4ed56f4041903/family1 is initiating major compaction (all files) 2023-11-20 08:55:23,255 INFO [Listener at localhost/43513] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-20 08:55:23,255 INFO [Listener at localhost/43513] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-20 08:55:23,255 INFO [Listener at localhost/43513] regionserver.HRegion(2259): Starting compaction of c417fce1816d885109d4ed56f4041903/family1 in testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903. 2023-11-20 08:55:23,256 INFO [Listener at localhost/43513] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/c7c38f61302543f6ab8b229d5a17e082, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/e1f18fc59fb04513b77458a0ca57c34c, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/1936fbed6edb4fbf92c2a753036428d6, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/1bda7aa2c54340fdb0f8c892a0fc0cc4, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/a89945a1f91f466e8a6bd9917d35a470] into tmpdir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/.tmp, totalSize=26.7 K 2023-11-20 08:55:23,256 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting c7c38f61302543f6ab8b229d5a17e082, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700470510335 2023-11-20 08:55:23,256 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting e1f18fc59fb04513b77458a0ca57c34c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700470512170 2023-11-20 08:55:23,257 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting 1936fbed6edb4fbf92c2a753036428d6, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700470513975 2023-11-20 08:55:23,257 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting 1bda7aa2c54340fdb0f8c892a0fc0cc4, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700470515775 2023-11-20 08:55:23,257 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting a89945a1f91f466e8a6bd9917d35a470, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-20 08:55:23,268 INFO [Listener at localhost/43513] throttle.PressureAwareThroughputController(145): c417fce1816d885109d4ed56f4041903#family1#compaction#109 average throughput is 0.85 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-20 08:55:23,333 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family2/49c61ac548624234b02ef1d4611f4e9e, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family2/101b13c82a8e45e6aeeecdcf4631c167, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family2/001fcf2941754af8b6f053118436cda2, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family2/abc8a0d5f47f4a589343d123fceadbce, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family2/f7d2fdf75ae440b1bd94ce7b7c58b8a8] to archive 2023-11-20 08:55:23,333 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:55:23,335 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family2/49c61ac548624234b02ef1d4611f4e9e to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family2/49c61ac548624234b02ef1d4611f4e9e 2023-11-20 08:55:23,336 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family2/101b13c82a8e45e6aeeecdcf4631c167 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family2/101b13c82a8e45e6aeeecdcf4631c167 2023-11-20 08:55:23,337 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family2/001fcf2941754af8b6f053118436cda2 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family2/001fcf2941754af8b6f053118436cda2 2023-11-20 08:55:23,338 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family2/abc8a0d5f47f4a589343d123fceadbce to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family2/abc8a0d5f47f4a589343d123fceadbce 2023-11-20 08:55:23,339 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family2/f7d2fdf75ae440b1bd94ce7b7c58b8a8 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family2/f7d2fdf75ae440b1bd94ce7b7c58b8a8 2023-11-20 08:55:23,677 INFO [Listener at localhost/43513] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202311208f43f9b159414f92a9ce2b73b447f9c1_del 2023-11-20 08:55:23,677 INFO [Listener at localhost/43513] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311208f43f9b159414f92a9ce2b73b447f9c1_del to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311208f43f9b159414f92a9ce2b73b447f9c1_del 2023-11-20 08:55:24,506 INFO [Listener at localhost/43513] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 52e4df4640ca47b7b7ae3e76723b1396 2023-11-20 08:55:24,507 DEBUG [Listener at localhost/43513] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/.tmp/family1/52e4df4640ca47b7b7ae3e76723b1396 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/52e4df4640ca47b7b7ae3e76723b1396 2023-11-20 08:55:24,510 INFO [Listener at localhost/43513] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 52e4df4640ca47b7b7ae3e76723b1396 2023-11-20 08:55:24,511 INFO [Listener at localhost/43513] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in c417fce1816d885109d4ed56f4041903/family1 of c417fce1816d885109d4ed56f4041903 into 52e4df4640ca47b7b7ae3e76723b1396(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-20 08:55:24,511 DEBUG [Listener at localhost/43513] regionserver.HRegion(2289): Compaction status journal for c417fce1816d885109d4ed56f4041903: 2023-11-20 08:55:24,511 DEBUG [Listener at localhost/43513] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-20 08:55:24,512 DEBUG [Listener at localhost/43513] regionserver.HStore(1912): c417fce1816d885109d4ed56f4041903/family2 is initiating major compaction (all files) 2023-11-20 08:55:24,512 INFO [Listener at localhost/43513] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-20 08:55:24,512 INFO [Listener at localhost/43513] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-20 08:55:24,512 INFO [Listener at localhost/43513] regionserver.HRegion(2259): Starting compaction of c417fce1816d885109d4ed56f4041903/family2 in testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903. 2023-11-20 08:55:24,512 INFO [Listener at localhost/43513] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family2/385ba0396fd141c2869c227cb1738afe, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family2/463ef75cff3349cfa57903e3803d583c, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family2/70b789bd0e2740bc862576c291870517, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family2/a4f7262c26c74982adfa4b452ffa6921, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family2/f7c9b13b663e4df5bd91db95e206f5a1] into tmpdir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/.tmp, totalSize=25.4 K 2023-11-20 08:55:24,512 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting 385ba0396fd141c2869c227cb1738afe, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700470510335 2023-11-20 08:55:24,513 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting 463ef75cff3349cfa57903e3803d583c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700470512170 2023-11-20 08:55:24,513 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting 70b789bd0e2740bc862576c291870517, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700470513975 2023-11-20 08:55:24,513 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting a4f7262c26c74982adfa4b452ffa6921, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700470515775 2023-11-20 08:55:24,514 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting f7c9b13b663e4df5bd91db95e206f5a1, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-20 08:55:24,524 INFO [Listener at localhost/43513] throttle.PressureAwareThroughputController(145): c417fce1816d885109d4ed56f4041903#family2#compaction#110 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-20 08:55:24,527 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/c7c38f61302543f6ab8b229d5a17e082, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/e1f18fc59fb04513b77458a0ca57c34c, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/1936fbed6edb4fbf92c2a753036428d6, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/1bda7aa2c54340fdb0f8c892a0fc0cc4, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/a89945a1f91f466e8a6bd9917d35a470] to archive 2023-11-20 08:55:24,528 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:55:24,530 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/c7c38f61302543f6ab8b229d5a17e082 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/c7c38f61302543f6ab8b229d5a17e082 2023-11-20 08:55:24,532 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/e1f18fc59fb04513b77458a0ca57c34c to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/e1f18fc59fb04513b77458a0ca57c34c 2023-11-20 08:55:24,533 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/1936fbed6edb4fbf92c2a753036428d6 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/1936fbed6edb4fbf92c2a753036428d6 2023-11-20 08:55:24,534 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/1bda7aa2c54340fdb0f8c892a0fc0cc4 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/1bda7aa2c54340fdb0f8c892a0fc0cc4 2023-11-20 08:55:24,535 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/a89945a1f91f466e8a6bd9917d35a470 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/a89945a1f91f466e8a6bd9917d35a470 2023-11-20 08:55:24,933 INFO [Listener at localhost/43513] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231120b7cb1e5487894c87aae2b07920f84156_del 2023-11-20 08:55:24,933 INFO [Listener at localhost/43513] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231120b7cb1e5487894c87aae2b07920f84156_del to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231120b7cb1e5487894c87aae2b07920f84156_del 2023-11-20 08:55:25,751 INFO [Listener at localhost/43513] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0ec5ede0b4444d9eb0d5dbeb92b8a047 2023-11-20 08:55:25,752 DEBUG [Listener at localhost/43513] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/.tmp/family2/0ec5ede0b4444d9eb0d5dbeb92b8a047 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family2/0ec5ede0b4444d9eb0d5dbeb92b8a047 2023-11-20 08:55:25,758 INFO [Listener at localhost/43513] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0ec5ede0b4444d9eb0d5dbeb92b8a047 2023-11-20 08:55:25,763 INFO [Listener at localhost/43513] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in c417fce1816d885109d4ed56f4041903/family2 of c417fce1816d885109d4ed56f4041903 into 0ec5ede0b4444d9eb0d5dbeb92b8a047(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-20 08:55:25,763 DEBUG [Listener at localhost/43513] regionserver.HRegion(2289): Compaction status journal for c417fce1816d885109d4ed56f4041903: 2023-11-20 08:55:25,763 DEBUG [Listener at localhost/43513] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-20 08:55:25,764 DEBUG [Listener at localhost/43513] regionserver.HStore(1912): 3c896a09e2b9659e521fbfa3f4c3a8b7/family1 is initiating major compaction (all files) 2023-11-20 08:55:25,764 INFO [Listener at localhost/43513] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-20 08:55:25,764 INFO [Listener at localhost/43513] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-20 08:55:25,764 INFO [Listener at localhost/43513] regionserver.HRegion(2259): Starting compaction of 3c896a09e2b9659e521fbfa3f4c3a8b7/family1 in testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7. 2023-11-20 08:55:25,764 INFO [Listener at localhost/43513] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/fa4d45a0dc0d44169e48cf27b5b4a06c, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/1e83151507e6498591a9f13142d5a99a, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/cf739c3495224991832bce73e7fff537, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/baa9f3cddff746cda812640b187caf04, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/5729d73bf359411c96f15f0865f73068] into tmpdir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/.tmp, totalSize=26.7 K 2023-11-20 08:55:25,765 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting fa4d45a0dc0d44169e48cf27b5b4a06c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700470510334 2023-11-20 08:55:25,766 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting 1e83151507e6498591a9f13142d5a99a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700470512170 2023-11-20 08:55:25,766 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting cf739c3495224991832bce73e7fff537, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700470513975 2023-11-20 08:55:25,767 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting baa9f3cddff746cda812640b187caf04, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700470515775 2023-11-20 08:55:25,767 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting 5729d73bf359411c96f15f0865f73068, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-20 08:55:25,780 INFO [Listener at localhost/43513] throttle.PressureAwareThroughputController(145): 3c896a09e2b9659e521fbfa3f4c3a8b7#family1#compaction#111 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-20 08:55:25,826 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family2/385ba0396fd141c2869c227cb1738afe, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family2/463ef75cff3349cfa57903e3803d583c, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family2/70b789bd0e2740bc862576c291870517, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family2/a4f7262c26c74982adfa4b452ffa6921, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family2/f7c9b13b663e4df5bd91db95e206f5a1] to archive 2023-11-20 08:55:25,827 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:55:25,829 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family2/385ba0396fd141c2869c227cb1738afe to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family2/385ba0396fd141c2869c227cb1738afe 2023-11-20 08:55:25,831 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family2/463ef75cff3349cfa57903e3803d583c to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family2/463ef75cff3349cfa57903e3803d583c 2023-11-20 08:55:25,832 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family2/70b789bd0e2740bc862576c291870517 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family2/70b789bd0e2740bc862576c291870517 2023-11-20 08:55:25,833 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family2/a4f7262c26c74982adfa4b452ffa6921 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family2/a4f7262c26c74982adfa4b452ffa6921 2023-11-20 08:55:25,834 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family2/f7c9b13b663e4df5bd91db95e206f5a1 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family2/f7c9b13b663e4df5bd91db95e206f5a1 2023-11-20 08:55:26,189 INFO [Listener at localhost/43513] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231120ec443306413b4ec1a2c11fe8bb028111_del 2023-11-20 08:55:26,190 INFO [Listener at localhost/43513] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231120ec443306413b4ec1a2c11fe8bb028111_del to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231120ec443306413b4ec1a2c11fe8bb028111_del 2023-11-20 08:55:26,205 INFO [Listener at localhost/43513] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 42fbaedc2d364ae49f9a4bd894028ca7 2023-11-20 08:55:26,205 DEBUG [Listener at localhost/43513] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/.tmp/family1/42fbaedc2d364ae49f9a4bd894028ca7 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/42fbaedc2d364ae49f9a4bd894028ca7 2023-11-20 08:55:26,213 INFO [Listener at localhost/43513] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 42fbaedc2d364ae49f9a4bd894028ca7 2023-11-20 08:55:26,214 INFO [Listener at localhost/43513] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 3c896a09e2b9659e521fbfa3f4c3a8b7/family1 of 3c896a09e2b9659e521fbfa3f4c3a8b7 into 42fbaedc2d364ae49f9a4bd894028ca7(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-20 08:55:26,214 DEBUG [Listener at localhost/43513] regionserver.HRegion(2289): Compaction status journal for 3c896a09e2b9659e521fbfa3f4c3a8b7: 2023-11-20 08:55:26,214 DEBUG [Listener at localhost/43513] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-20 08:55:26,215 DEBUG [Listener at localhost/43513] regionserver.HStore(1912): 3c896a09e2b9659e521fbfa3f4c3a8b7/family2 is initiating major compaction (all files) 2023-11-20 08:55:26,215 INFO [Listener at localhost/43513] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-20 08:55:26,215 INFO [Listener at localhost/43513] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-20 08:55:26,215 INFO [Listener at localhost/43513] regionserver.HRegion(2259): Starting compaction of 3c896a09e2b9659e521fbfa3f4c3a8b7/family2 in testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7. 2023-11-20 08:55:26,215 INFO [Listener at localhost/43513] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family2/c58b680b02974ce3a6dfe6eb61247c8a, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family2/f352ce62aae04c87b30585be76110820, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family2/f06094b14986481ea9ae6a16eeb26f98, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family2/b21ad80b056243bb82c80545bb922fa9, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family2/cd927f66457f463f95bde8b40deccf4f] into tmpdir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/.tmp, totalSize=25.4 K 2023-11-20 08:55:26,216 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting c58b680b02974ce3a6dfe6eb61247c8a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700470510334 2023-11-20 08:55:26,216 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting f352ce62aae04c87b30585be76110820, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700470512170 2023-11-20 08:55:26,216 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting f06094b14986481ea9ae6a16eeb26f98, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700470513975 2023-11-20 08:55:26,217 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting b21ad80b056243bb82c80545bb922fa9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700470515775 2023-11-20 08:55:26,217 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting cd927f66457f463f95bde8b40deccf4f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-20 08:55:26,226 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/fa4d45a0dc0d44169e48cf27b5b4a06c, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/1e83151507e6498591a9f13142d5a99a, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/cf739c3495224991832bce73e7fff537, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/baa9f3cddff746cda812640b187caf04, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/5729d73bf359411c96f15f0865f73068] to archive 2023-11-20 08:55:26,227 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:55:26,229 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/fa4d45a0dc0d44169e48cf27b5b4a06c to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/fa4d45a0dc0d44169e48cf27b5b4a06c 2023-11-20 08:55:26,232 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/1e83151507e6498591a9f13142d5a99a to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/1e83151507e6498591a9f13142d5a99a 2023-11-20 08:55:26,233 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/cf739c3495224991832bce73e7fff537 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/cf739c3495224991832bce73e7fff537 2023-11-20 08:55:26,235 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/baa9f3cddff746cda812640b187caf04 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/baa9f3cddff746cda812640b187caf04 2023-11-20 08:55:26,237 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/5729d73bf359411c96f15f0865f73068 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/5729d73bf359411c96f15f0865f73068 2023-11-20 08:55:26,242 INFO [Listener at localhost/43513] throttle.PressureAwareThroughputController(145): 3c896a09e2b9659e521fbfa3f4c3a8b7#family2#compaction#112 average throughput is 0.15 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-20 08:55:26,655 INFO [Listener at localhost/43513] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202311200ecdd649908243629a4ee307e36761fd_del 2023-11-20 08:55:26,655 INFO [Listener at localhost/43513] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311200ecdd649908243629a4ee307e36761fd_del to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311200ecdd649908243629a4ee307e36761fd_del 2023-11-20 08:55:27,475 INFO [Listener at localhost/43513] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5be5fa4774c7438c890f5baa21cdc0bd 2023-11-20 08:55:27,476 DEBUG [Listener at localhost/43513] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/.tmp/family2/5be5fa4774c7438c890f5baa21cdc0bd as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family2/5be5fa4774c7438c890f5baa21cdc0bd 2023-11-20 08:55:27,480 INFO [Listener at localhost/43513] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5be5fa4774c7438c890f5baa21cdc0bd 2023-11-20 08:55:27,481 INFO [Listener at localhost/43513] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 3c896a09e2b9659e521fbfa3f4c3a8b7/family2 of 3c896a09e2b9659e521fbfa3f4c3a8b7 into 5be5fa4774c7438c890f5baa21cdc0bd(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-20 08:55:27,481 DEBUG [Listener at localhost/43513] regionserver.HRegion(2289): Compaction status journal for 3c896a09e2b9659e521fbfa3f4c3a8b7: 2023-11-20 08:55:27,487 DEBUG [Listener at localhost/43513] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-20 08:55:27,491 DEBUG [Listener at localhost/43513] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-20 08:55:27,496 DEBUG [Listener at localhost/43513] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-20 08:55:27,497 DEBUG [Listener at localhost/43513] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-20 08:55:27,504 INFO [Listener at localhost/43513] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-20 08:55:27,526 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family2/c58b680b02974ce3a6dfe6eb61247c8a, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family2/f352ce62aae04c87b30585be76110820, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family2/f06094b14986481ea9ae6a16eeb26f98, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family2/b21ad80b056243bb82c80545bb922fa9, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family2/cd927f66457f463f95bde8b40deccf4f] to archive 2023-11-20 08:55:27,527 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:55:27,532 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family2/c58b680b02974ce3a6dfe6eb61247c8a to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family2/c58b680b02974ce3a6dfe6eb61247c8a 2023-11-20 08:55:27,534 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family2/f352ce62aae04c87b30585be76110820 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family2/f352ce62aae04c87b30585be76110820 2023-11-20 08:55:27,535 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family2/f06094b14986481ea9ae6a16eeb26f98 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family2/f06094b14986481ea9ae6a16eeb26f98 2023-11-20 08:55:27,537 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family2/b21ad80b056243bb82c80545bb922fa9 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family2/b21ad80b056243bb82c80545bb922fa9 2023-11-20 08:55:27,538 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family2/cd927f66457f463f95bde8b40deccf4f to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family2/cd927f66457f463f95bde8b40deccf4f 2023-11-20 08:55:27,546 INFO [Listener at localhost/43513] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-11-20 08:55:27,550 INFO [Listener at localhost/43513] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202311204fa30d13c1654ead9e0851d8faa2dba7_del 2023-11-20 08:55:27,553 INFO [Listener at localhost/43513] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231120ec443306413b4ec1a2c11fe8bb028111_del 2023-11-20 08:55:27,557 INFO [Listener at localhost/43513] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202311208f43f9b159414f92a9ce2b73b447f9c1_del 2023-11-20 08:55:27,557 INFO [Listener at localhost/43513] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testCompactionWithHFileLink' column='family1' 2023-11-20 08:55:27,559 DEBUG [Listener at localhost/43513] zookeeper.ReadOnlyZKClient(139): Connect 0x4b30df42 to 127.0.0.1:64635 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-20 08:55:27,568 DEBUG [Listener at localhost/43513] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1c61675b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-20 08:55:27,568 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231120 for table='testCompactionWithHFileLink' and column='family1' 2023-11-20 08:55:27,572 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231120 for table='testCompactionWithHFileLink' and column='family1' 2023-11-20 08:55:27,587 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231120 for table='testCompactionWithHFileLink' and column='family1' 2023-11-20 08:55:28,463 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311203f2ddcd6ed0c4bac80773506813aceec to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311203f2ddcd6ed0c4bac80773506813aceec 2023-11-20 08:55:28,464 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231120 table='testCompactionWithHFileLink' column='family1' 2023-11-20 08:55:28,477 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-20 08:55:28,478 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231120a9d3bd8e036e47b0bc598498c6a3774e to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231120a9d3bd8e036e47b0bc598498c6a3774e 2023-11-20 08:55:28,481 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231120 table='testCompactionWithHFileLink' column='family1' 2023-11-20 08:55:28,481 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54054, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-20 08:55:28,483 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023112003c670d8316d4132b99d5965589f3787 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023112003c670d8316d4132b99d5965589f3787 2023-11-20 08:55:28,484 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231120 table='testCompactionWithHFileLink' column='family1' 2023-11-20 08:55:28,487 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-20 08:55:28,489 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50650, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-20 08:55:28,508 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231120/family1/8da6ece55a43432f8c109964b8a757c7 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-11-20 08:55:28,512 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903., hostname=jenkins-hbase4.apache.org,38491,1700470412215, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231120/family1/8da6ece55a43432f8c109964b8a757c7}] 2023-11-20 08:55:28,518 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(763): Validating hfile at hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231120/family1/8da6ece55a43432f8c109964b8a757c7 for inclusion in c417fce1816d885109d4ed56f4041903/family1 2023-11-20 08:55:28,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-11-20 08:55:28,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-20 08:55:28,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HRegion(2446): Flush status journal for c417fce1816d885109d4ed56f4041903: 2023-11-20 08:55:28,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231120/family1/8da6ece55a43432f8c109964b8a757c7 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testCompactionWithHFileLink__tv6g0k3h9uikvv9802btgostja6dgbrlvfr6erfv2i324gh4v40jbuvkg9o62is5/family1/8da6ece55a43432f8c109964b8a757c7 2023-11-20 08:55:28,525 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231120/family1/9d73f2d69de749db9c28ca899165247e first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-11-20 08:55:28,527 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7., hostname=jenkins-hbase4.apache.org,38491,1700470412215, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231120/family1/9d73f2d69de749db9c28ca899165247e}] 2023-11-20 08:55:28,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testCompactionWithHFileLink__tv6g0k3h9uikvv9802btgostja6dgbrlvfr6erfv2i324gh4v40jbuvkg9o62is5/family1/8da6ece55a43432f8c109964b8a757c7 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/3f873b67318744edab220630159865d7_SeqId_29_ 2023-11-20 08:55:28,529 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231120/family1/af424976eed6448aaa6beb98de00d050 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-11-20 08:55:28,530 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(849): Loaded HFile hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testCompactionWithHFileLink__tv6g0k3h9uikvv9802btgostja6dgbrlvfr6erfv2i324gh4v40jbuvkg9o62is5/family1/8da6ece55a43432f8c109964b8a757c7 into c417fce1816d885109d4ed56f4041903/family1 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/3f873b67318744edab220630159865d7_SeqId_29_ - updating store file list. 2023-11-20 08:55:28,530 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd., hostname=jenkins-hbase4.apache.org,38491,1700470412215, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231120/family1/af424976eed6448aaa6beb98de00d050}] 2023-11-20 08:55:28,530 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38491] regionserver.HStore(763): Validating hfile at hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231120/family1/9d73f2d69de749db9c28ca899165247e for inclusion in 3c896a09e2b9659e521fbfa3f4c3a8b7/family1 2023-11-20 08:55:28,532 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HStore(763): Validating hfile at hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231120/family1/af424976eed6448aaa6beb98de00d050 for inclusion in 85ad044c09ac7e7f46d086f5a2df28bd/family1 2023-11-20 08:55:28,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38491] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-11-20 08:55:28,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38491] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-20 08:55:28,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38491] regionserver.HRegion(2446): Flush status journal for 3c896a09e2b9659e521fbfa3f4c3a8b7: 2023-11-20 08:55:28,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38491] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231120/family1/9d73f2d69de749db9c28ca899165247e to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testCompactionWithHFileLink__aeed2mcol66jckenpu2kiqrduojbg1gi8gqi5tjtgtphj58jv0o8kde858v210de/family1/9d73f2d69de749db9c28ca899165247e 2023-11-20 08:55:28,535 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(882): Loaded HFile hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/3f873b67318744edab220630159865d7_SeqId_29_ into c417fce1816d885109d4ed56f4041903/family1 2023-11-20 08:55:28,535 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.HStore(855): Successfully loaded hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testCompactionWithHFileLink__tv6g0k3h9uikvv9802btgostja6dgbrlvfr6erfv2i324gh4v40jbuvkg9o62is5/family1/8da6ece55a43432f8c109964b8a757c7 into c417fce1816d885109d4ed56f4041903/family1 (new location: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/3f873b67318744edab220630159865d7_SeqId_29_) 2023-11-20 08:55:28,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-11-20 08:55:28,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HStore(777): Region bounds: first= last=1 2023-11-20 08:55:28,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HRegion(2446): Flush status journal for 85ad044c09ac7e7f46d086f5a2df28bd: 2023-11-20 08:55:28,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38491] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testCompactionWithHFileLink__tv6g0k3h9uikvv9802btgostja6dgbrlvfr6erfv2i324gh4v40jbuvkg9o62is5/family1/8da6ece55a43432f8c109964b8a757c7 2023-11-20 08:55:28,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38491] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testCompactionWithHFileLink__aeed2mcol66jckenpu2kiqrduojbg1gi8gqi5tjtgtphj58jv0o8kde858v210de/family1/9d73f2d69de749db9c28ca899165247e as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/963d00887e7947498904a9f4ebf5a112_SeqId_29_ 2023-11-20 08:55:28,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231120/family1/af424976eed6448aaa6beb98de00d050 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testCompactionWithHFileLink__75claj9oltlvd84f9ggsga9i8unhftemgrqjeguofkr4g3sh2re1a64m2sn9on3d/family1/af424976eed6448aaa6beb98de00d050 2023-11-20 08:55:28,537 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38491] regionserver.HStore(849): Loaded HFile hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testCompactionWithHFileLink__aeed2mcol66jckenpu2kiqrduojbg1gi8gqi5tjtgtphj58jv0o8kde858v210de/family1/9d73f2d69de749db9c28ca899165247e into 3c896a09e2b9659e521fbfa3f4c3a8b7/family1 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/963d00887e7947498904a9f4ebf5a112_SeqId_29_ - updating store file list. 2023-11-20 08:55:28,539 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231120 table='testCompactionWithHFileLink' column='family1' 2023-11-20 08:55:28,540 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:55:28,540 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38491] regionserver.HStore(882): Loaded HFile hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/963d00887e7947498904a9f4ebf5a112_SeqId_29_ into 3c896a09e2b9659e521fbfa3f4c3a8b7/family1 2023-11-20 08:55:28,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testCompactionWithHFileLink__75claj9oltlvd84f9ggsga9i8unhftemgrqjeguofkr4g3sh2re1a64m2sn9on3d/family1/af424976eed6448aaa6beb98de00d050 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/4eae363c8ea44156a7a794a24bbdfcdc_SeqId_29_ 2023-11-20 08:55:28,540 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38491] regionserver.HStore(855): Successfully loaded hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testCompactionWithHFileLink__aeed2mcol66jckenpu2kiqrduojbg1gi8gqi5tjtgtphj58jv0o8kde858v210de/family1/9d73f2d69de749db9c28ca899165247e into 3c896a09e2b9659e521fbfa3f4c3a8b7/family1 (new location: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/963d00887e7947498904a9f4ebf5a112_SeqId_29_) 2023-11-20 08:55:28,541 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HStore(849): Loaded HFile hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testCompactionWithHFileLink__75claj9oltlvd84f9ggsga9i8unhftemgrqjeguofkr4g3sh2re1a64m2sn9on3d/family1/af424976eed6448aaa6beb98de00d050 into 85ad044c09ac7e7f46d086f5a2df28bd/family1 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/4eae363c8ea44156a7a794a24bbdfcdc_SeqId_29_ - updating store file list. 2023-11-20 08:55:28,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38491] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testCompactionWithHFileLink__aeed2mcol66jckenpu2kiqrduojbg1gi8gqi5tjtgtphj58jv0o8kde858v210de/family1/9d73f2d69de749db9c28ca899165247e 2023-11-20 08:55:28,542 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311200b72f04ed9dd4745a7416f9fa3f787a3 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311200b72f04ed9dd4745a7416f9fa3f787a3 2023-11-20 08:55:28,543 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023112043f1cb2484844d628527c6caeae200f2 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023112043f1cb2484844d628527c6caeae200f2 2023-11-20 08:55:28,544 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231120c8a666d226eb4104ad21c3355768bd45 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231120c8a666d226eb4104ad21c3355768bd45 2023-11-20 08:55:28,545 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HStore(882): Loaded HFile hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/4eae363c8ea44156a7a794a24bbdfcdc_SeqId_29_ into 85ad044c09ac7e7f46d086f5a2df28bd/family1 2023-11-20 08:55:28,545 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HStore(855): Successfully loaded hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testCompactionWithHFileLink__75claj9oltlvd84f9ggsga9i8unhftemgrqjeguofkr4g3sh2re1a64m2sn9on3d/family1/af424976eed6448aaa6beb98de00d050 into 85ad044c09ac7e7f46d086f5a2df28bd/family1 (new location: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/4eae363c8ea44156a7a794a24bbdfcdc_SeqId_29_) 2023-11-20 08:55:28,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testCompactionWithHFileLink__75claj9oltlvd84f9ggsga9i8unhftemgrqjeguofkr4g3sh2re1a64m2sn9on3d/family1/af424976eed6448aaa6beb98de00d050 2023-11-20 08:55:28,546 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231120f43bf08d68b04c5a9298bb294a99ac9d to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231120f43bf08d68b04c5a9298bb294a99ac9d 2023-11-20 08:55:28,546 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-20 08:55:28,546 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231120' 2023-11-20 08:55:28,546 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231120 table='testCompactionWithHFileLink' column='family1' 2023-11-20 08:55:28,546 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231120 for table='testCompactionWithHFileLink' and column='family1' 2023-11-20 08:55:28,547 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:55:28,547 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231120 table='testCompactionWithHFileLink' column='family1' 2023-11-20 08:55:28,548 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:55:28,548 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231120f6195321ff784ce38b2bddfe7d5789b6 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231120f6195321ff784ce38b2bddfe7d5789b6 2023-11-20 08:55:28,549 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023112071cf63e3fb3c40b0b53c32617f3340d7 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023112071cf63e3fb3c40b0b53c32617f3340d7 2023-11-20 08:55:28,550 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231120f7517fe0ca684f6e92feb428804de37b to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231120f7517fe0ca684f6e92feb428804de37b 2023-11-20 08:55:28,550 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023112078d310eea24740eba786d4ea973a0f92 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023112078d310eea24740eba786d4ea973a0f92 2023-11-20 08:55:28,551 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231120fa10b641104a46d0b823e14b92103359 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231120fa10b641104a46d0b823e14b92103359 2023-11-20 08:55:28,552 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231120b8666ade0d124147b4c3e46c3763ef30 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231120b8666ade0d124147b4c3e46c3763ef30 2023-11-20 08:55:28,552 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231120fcb9f5f048a143efb087851bd58889cb to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231120fcb9f5f048a143efb087851bd58889cb 2023-11-20 08:55:28,552 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-20 08:55:28,552 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231120' 2023-11-20 08:55:28,553 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231120 for table='testCompactionWithHFileLink' and column='family1' 2023-11-20 08:55:28,553 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231120c38961dec1a24a4fa49ebbccf556edd5 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231120c38961dec1a24a4fa49ebbccf556edd5 2023-11-20 08:55:28,553 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-20 08:55:28,553 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231120' 2023-11-20 08:55:28,553 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231120 for table='testCompactionWithHFileLink' and column='family1' 2023-11-20 08:55:28,553 INFO [Listener at localhost/43513] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-11-20 08:55:28,554 INFO [Listener at localhost/43513] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testCompactionWithHFileLink' and column='family1' 2023-11-20 08:55:28,554 INFO [Listener at localhost/43513] compactions.PartitionedMobCompactor(367): [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311204fa30d13c1654ead9e0851d8faa2dba7_del] 2023-11-20 08:55:28,554 DEBUG [Listener at localhost/43513] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:55:28,555 DEBUG [Listener at localhost/43513] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311204fa30d13c1654ead9e0851d8faa2dba7_del to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311204fa30d13c1654ead9e0851d8faa2dba7_del 2023-11-20 08:55:28,555 INFO [Listener at localhost/43513] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-11-20 08:55:28,555 INFO [Listener at localhost/43513] compactions.PartitionedMobCompactor(367): [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231120ec443306413b4ec1a2c11fe8bb028111_del] 2023-11-20 08:55:28,556 DEBUG [Listener at localhost/43513] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:55:28,557 DEBUG [Listener at localhost/43513] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231120ec443306413b4ec1a2c11fe8bb028111_del to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231120ec443306413b4ec1a2c11fe8bb028111_del 2023-11-20 08:55:28,557 INFO [Listener at localhost/43513] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-11-20 08:55:28,557 INFO [Listener at localhost/43513] compactions.PartitionedMobCompactor(367): [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311208f43f9b159414f92a9ce2b73b447f9c1_del] 2023-11-20 08:55:28,559 DEBUG [Listener at localhost/43513] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:55:28,561 DEBUG [Listener at localhost/43513] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311208f43f9b159414f92a9ce2b73b447f9c1_del to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311208f43f9b159414f92a9ce2b73b447f9c1_del 2023-11-20 08:55:28,561 INFO [Listener at localhost/43513] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-11-20 08:55:28,563 DEBUG [Listener at localhost/43513] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-20 08:55:28,567 DEBUG [Listener at localhost/43513] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-20 08:55:28,570 DEBUG [Listener at localhost/43513] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-20 08:55:28,570 DEBUG [Listener at localhost/43513] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-20 08:55:28,576 INFO [Listener at localhost/43513] client.HBaseAdmin$15(890): Started disable of testCompactionWithHFileLink 2023-11-20 08:55:28,576 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testCompactionWithHFileLink 2023-11-20 08:55:28,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] procedure2.ProcedureExecutor(1028): Stored pid=88, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testCompactionWithHFileLink 2023-11-20 08:55:28,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-11-20 08:55:28,580 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700470528580"}]},"ts":"1700470528580"} 2023-11-20 08:55:28,581 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLING in hbase:meta 2023-11-20 08:55:28,583 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testCompactionWithHFileLink to state=DISABLING 2023-11-20 08:55:28,583 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=85ad044c09ac7e7f46d086f5a2df28bd, UNASSIGN}, {pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=3c896a09e2b9659e521fbfa3f4c3a8b7, UNASSIGN}, {pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c417fce1816d885109d4ed56f4041903, UNASSIGN}] 2023-11-20 08:55:28,585 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=3c896a09e2b9659e521fbfa3f4c3a8b7, UNASSIGN 2023-11-20 08:55:28,585 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=85ad044c09ac7e7f46d086f5a2df28bd, UNASSIGN 2023-11-20 08:55:28,585 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c417fce1816d885109d4ed56f4041903, UNASSIGN 2023-11-20 08:55:28,585 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=3c896a09e2b9659e521fbfa3f4c3a8b7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:28,585 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700470528585"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700470528585"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700470528585"}]},"ts":"1700470528585"} 2023-11-20 08:55:28,586 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=85ad044c09ac7e7f46d086f5a2df28bd, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:28,586 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=c417fce1816d885109d4ed56f4041903, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:28,586 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700470528586"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700470528586"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700470528586"}]},"ts":"1700470528586"} 2023-11-20 08:55:28,586 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700470528586"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700470528586"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700470528586"}]},"ts":"1700470528586"} 2023-11-20 08:55:28,587 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=92, ppid=90, state=RUNNABLE; CloseRegionProcedure 3c896a09e2b9659e521fbfa3f4c3a8b7, server=jenkins-hbase4.apache.org,38491,1700470412215}] 2023-11-20 08:55:28,587 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=89, state=RUNNABLE; CloseRegionProcedure 85ad044c09ac7e7f46d086f5a2df28bd, server=jenkins-hbase4.apache.org,38491,1700470412215}] 2023-11-20 08:55:28,588 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; CloseRegionProcedure c417fce1816d885109d4ed56f4041903, server=jenkins-hbase4.apache.org,38491,1700470412215}] 2023-11-20 08:55:28,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-11-20 08:55:28,738 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:28,739 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 3c896a09e2b9659e521fbfa3f4c3a8b7 2023-11-20 08:55:28,739 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3c896a09e2b9659e521fbfa3f4c3a8b7, disabling compactions & flushes 2023-11-20 08:55:28,739 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7. 2023-11-20 08:55:28,739 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7. 2023-11-20 08:55:28,739 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7. after waiting 0 ms 2023-11-20 08:55:28,739 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7. 2023-11-20 08:55:28,743 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-11-20 08:55:28,744 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7. 2023-11-20 08:55:28,744 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3c896a09e2b9659e521fbfa3f4c3a8b7: 2023-11-20 08:55:28,745 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 3c896a09e2b9659e521fbfa3f4c3a8b7 2023-11-20 08:55:28,745 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c417fce1816d885109d4ed56f4041903 2023-11-20 08:55:28,745 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c417fce1816d885109d4ed56f4041903, disabling compactions & flushes 2023-11-20 08:55:28,745 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903. 2023-11-20 08:55:28,745 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903. 2023-11-20 08:55:28,745 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903. after waiting 0 ms 2023-11-20 08:55:28,745 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903. 2023-11-20 08:55:28,745 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=3c896a09e2b9659e521fbfa3f4c3a8b7, regionState=CLOSED 2023-11-20 08:55:28,746 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700470528745"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700470528745"}]},"ts":"1700470528745"} 2023-11-20 08:55:28,748 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=92, resume processing ppid=90 2023-11-20 08:55:28,748 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; CloseRegionProcedure 3c896a09e2b9659e521fbfa3f4c3a8b7, server=jenkins-hbase4.apache.org,38491,1700470412215 in 160 msec 2023-11-20 08:55:28,749 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=90, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=3c896a09e2b9659e521fbfa3f4c3a8b7, UNASSIGN in 165 msec 2023-11-20 08:55:28,749 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-11-20 08:55:28,750 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903. 2023-11-20 08:55:28,750 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c417fce1816d885109d4ed56f4041903: 2023-11-20 08:55:28,751 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c417fce1816d885109d4ed56f4041903 2023-11-20 08:55:28,751 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 85ad044c09ac7e7f46d086f5a2df28bd 2023-11-20 08:55:28,752 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 85ad044c09ac7e7f46d086f5a2df28bd, disabling compactions & flushes 2023-11-20 08:55:28,752 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd. 2023-11-20 08:55:28,752 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd. 2023-11-20 08:55:28,752 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd. after waiting 0 ms 2023-11-20 08:55:28,752 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd. 2023-11-20 08:55:28,752 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=c417fce1816d885109d4ed56f4041903, regionState=CLOSED 2023-11-20 08:55:28,752 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700470528752"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700470528752"}]},"ts":"1700470528752"} 2023-11-20 08:55:28,754 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=91 2023-11-20 08:55:28,754 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=91, state=SUCCESS; CloseRegionProcedure c417fce1816d885109d4ed56f4041903, server=jenkins-hbase4.apache.org,38491,1700470412215 in 165 msec 2023-11-20 08:55:28,755 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c417fce1816d885109d4ed56f4041903, UNASSIGN in 171 msec 2023-11-20 08:55:28,755 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-11-20 08:55:28,756 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd. 2023-11-20 08:55:28,756 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 85ad044c09ac7e7f46d086f5a2df28bd: 2023-11-20 08:55:28,757 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 85ad044c09ac7e7f46d086f5a2df28bd 2023-11-20 08:55:28,758 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=85ad044c09ac7e7f46d086f5a2df28bd, regionState=CLOSED 2023-11-20 08:55:28,758 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700470528758"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700470528758"}]},"ts":"1700470528758"} 2023-11-20 08:55:28,760 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=89 2023-11-20 08:55:28,760 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=89, state=SUCCESS; CloseRegionProcedure 85ad044c09ac7e7f46d086f5a2df28bd, server=jenkins-hbase4.apache.org,38491,1700470412215 in 172 msec 2023-11-20 08:55:28,761 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=89, resume processing ppid=88 2023-11-20 08:55:28,761 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=89, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=85ad044c09ac7e7f46d086f5a2df28bd, UNASSIGN in 177 msec 2023-11-20 08:55:28,762 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700470528761"}]},"ts":"1700470528761"} 2023-11-20 08:55:28,762 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLED in hbase:meta 2023-11-20 08:55:28,765 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testCompactionWithHFileLink to state=DISABLED 2023-11-20 08:55:28,766 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=88, state=SUCCESS; DisableTableProcedure table=testCompactionWithHFileLink in 188 msec 2023-11-20 08:55:28,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-11-20 08:55:28,882 INFO [Listener at localhost/43513] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testCompactionWithHFileLink, procId: 88 completed 2023-11-20 08:55:28,892 INFO [Listener at localhost/43513] client.HBaseAdmin(2586): Taking restore-failsafe snapshot: hbase-failsafe-snaptb-1700470517570-1700470528892 2023-11-20 08:55:28,893 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=hbase-failsafe-snaptb-1700470517570-1700470528892 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-20 08:55:28,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1700470528893 (current time:1700470528893). 2023-11-20 08:55:28,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-11-20 08:55:28,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] zookeeper.ReadOnlyZKClient(139): Connect 0x4dedb2ee to 127.0.0.1:64635 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-20 08:55:28,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@63910aaf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-20 08:55:28,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-20 08:55:28,901 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54062, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-20 08:55:28,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4dedb2ee to 127.0.0.1:64635 2023-11-20 08:55:28,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-20 08:55:28,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-11-20 08:55:28,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] snapshot.SnapshotManager(695): Table is disabled, running snapshot entirely on master for { ss=hbase-failsafe-snaptb-1700470517570-1700470528892 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-20 08:55:28,904 WARN [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.hbase-snapshot, current working dir path: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1700470517570-1700470528892 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotDisabledTable(SnapshotManager.java:541) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:698) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-11-20 08:55:28,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-20 08:55:28,906 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-20 08:55:28,907 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1700471128907 2023-11-20 08:55:28,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] snapshot.SnapshotManager(700): Started snapshot: { ss=hbase-failsafe-snaptb-1700470517570-1700470528892 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-20 08:55:28,907 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running DISABLED table snapshot hbase-failsafe-snaptb-1700470517570-1700470528892 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-11-20 08:55:28,907 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase-failsafe-snaptb-1700470517570-1700470528892 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-11-20 08:55:28,907 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-11-20 08:55:29,007 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-20 08:55:29,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1700470517570-1700470528892 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-20 08:55:29,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1700470517570-1700470528892 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-20 08:55:29,008 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-11-20 08:55:29,208 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-20 08:55:29,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1700470517570-1700470528892 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-20 08:55:29,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1700470517570-1700470528892 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-20 08:55:29,210 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-11-20 08:55:29,313 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.DisabledTableSnapshotHandler(97): Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1700470517570-1700470528892 table=testCompactionWithHFileLink type=DISABLED ttl=0 } 2023-11-20 08:55:29,315 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-20 08:55:29,315 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-20 08:55:29,315 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-20 08:55:29,315 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-20 08:55:29,315 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-20 08:55:29,315 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-20 08:55:29,315 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-20 08:55:29,315 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-20 08:55:29,318 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/42fbaedc2d364ae49f9a4bd894028ca7, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/963d00887e7947498904a9f4ebf5a112_SeqId_29_] hfiles 2023-11-20 08:55:29,318 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/42fbaedc2d364ae49f9a4bd894028ca7 2023-11-20 08:55:29,318 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/02380f8ff7534e04bd6489d09f7ff6aa, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/4eae363c8ea44156a7a794a24bbdfcdc_SeqId_29_] hfiles 2023-11-20 08:55:29,318 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/963d00887e7947498904a9f4ebf5a112_SeqId_29_ 2023-11-20 08:55:29,318 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/02380f8ff7534e04bd6489d09f7ff6aa 2023-11-20 08:55:29,318 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/4eae363c8ea44156a7a794a24bbdfcdc_SeqId_29_ 2023-11-20 08:55:29,318 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023112003c670d8316d4132b99d5965589f3787, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311203f2ddcd6ed0c4bac80773506813aceec, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231120a9d3bd8e036e47b0bc598498c6a3774e] hfiles 2023-11-20 08:55:29,319 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/3): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023112003c670d8316d4132b99d5965589f3787 2023-11-20 08:55:29,319 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family2/5be5fa4774c7438c890f5baa21cdc0bd] hfiles 2023-11-20 08:55:29,319 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/3): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311203f2ddcd6ed0c4bac80773506813aceec 2023-11-20 08:55:29,319 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family2/5be5fa4774c7438c890f5baa21cdc0bd 2023-11-20 08:55:29,319 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/3): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231120a9d3bd8e036e47b0bc598498c6a3774e 2023-11-20 08:55:29,319 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family2/333b1ec1b6eb46fa8831bea68ceb6588] hfiles 2023-11-20 08:55:29,319 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family2/333b1ec1b6eb46fa8831bea68ceb6588 2023-11-20 08:55:29,322 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/3f873b67318744edab220630159865d7_SeqId_29_, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/52e4df4640ca47b7b7ae3e76723b1396] hfiles 2023-11-20 08:55:29,323 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/3f873b67318744edab220630159865d7_SeqId_29_ 2023-11-20 08:55:29,323 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/52e4df4640ca47b7b7ae3e76723b1396 2023-11-20 08:55:29,323 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family2/0ec5ede0b4444d9eb0d5dbeb92b8a047] hfiles 2023-11-20 08:55:29,323 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family2/0ec5ede0b4444d9eb0d5dbeb92b8a047 2023-11-20 08:55:29,325 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311200ecdd649908243629a4ee307e36761fd_del, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023112018495699c31f408da2e0a6767e48908a, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023112069b1b21c29ba4a408399e00e6a539d77, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311207db876887b2241a58255cdc12b2629da, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311209a767d91a1f54c938fe436b7e2d849ea, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023112000f56181a8024486beb01a9b1642cef8, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231120b7cb1e5487894c87aae2b07920f84156_del, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231120bbd312ae0aaf4858987955fa95433203, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231120c4d22fe067304851ab9264447a9b7e6e, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231120e042cad0e43e40588ac8ebe33e6ee08f, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231120210fabca21a64a5088b7b4e16b28d5e1, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311204814a666a36f4f4e8fe6db88040d84d5_del, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311207f281bbcfb78444ab67947a609b6eb35, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231120a5a8a2bbf75e424fab2f9d4ef9f18083, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231120bfaf6d4837ad46e3af28fbb32ac0cb79] hfiles 2023-11-20 08:55:29,326 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/15): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311200ecdd649908243629a4ee307e36761fd_del 2023-11-20 08:55:29,326 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/15): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023112018495699c31f408da2e0a6767e48908a 2023-11-20 08:55:29,326 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/15): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023112069b1b21c29ba4a408399e00e6a539d77 2023-11-20 08:55:29,326 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (4/15): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311207db876887b2241a58255cdc12b2629da 2023-11-20 08:55:29,326 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (5/15): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311209a767d91a1f54c938fe436b7e2d849ea 2023-11-20 08:55:29,326 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (6/15): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023112000f56181a8024486beb01a9b1642cef8 2023-11-20 08:55:29,326 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (7/15): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231120b7cb1e5487894c87aae2b07920f84156_del 2023-11-20 08:55:29,326 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (8/15): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231120bbd312ae0aaf4858987955fa95433203 2023-11-20 08:55:29,326 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (9/15): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231120c4d22fe067304851ab9264447a9b7e6e 2023-11-20 08:55:29,326 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (10/15): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231120e042cad0e43e40588ac8ebe33e6ee08f 2023-11-20 08:55:29,326 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (11/15): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231120210fabca21a64a5088b7b4e16b28d5e1 2023-11-20 08:55:29,326 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (12/15): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311204814a666a36f4f4e8fe6db88040d84d5_del 2023-11-20 08:55:29,326 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (13/15): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311207f281bbcfb78444ab67947a609b6eb35 2023-11-20 08:55:29,326 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (14/15): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231120a5a8a2bbf75e424fab2f9d4ef9f18083 2023-11-20 08:55:29,326 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (15/15): hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231120bfaf6d4837ad46e3af28fbb32ac0cb79 2023-11-20 08:55:29,510 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-20 08:55:29,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1700470517570-1700470528892 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-20 08:55:29,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1700470517570-1700470528892 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-20 08:55:29,511 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-11-20 08:55:29,745 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.DisabledTableSnapshotHandler(120): Marking snapshot{ ss=hbase-failsafe-snaptb-1700470517570-1700470528892 table=testCompactionWithHFileLink type=DISABLED ttl=0 } as finished. 2023-11-20 08:55:29,745 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase-failsafe-snaptb-1700470517570-1700470528892 2023-11-20 08:55:29,746 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1700470517570-1700470528892 2023-11-20 08:55:30,012 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-20 08:55:30,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1700470517570-1700470528892 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-20 08:55:30,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1700470517570-1700470528892 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-20 08:55:30,013 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-11-20 08:55:30,180 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1700470517570-1700470528892 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.hbase-snapshot/hbase-failsafe-snaptb-1700470517570-1700470528892 2023-11-20 08:55:30,181 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase-failsafe-snaptb-1700470517570-1700470528892 of table testCompactionWithHFileLink completed 2023-11-20 08:55:30,181 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1700470517570-1700470528892 2023-11-20 08:55:30,181 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1700470517570-1700470528892 2023-11-20 08:55:30,181 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running DISABLED table snapshot hbase-failsafe-snaptb-1700470517570-1700470528892 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1700470528907Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1700470517570-1700470528892 table=testCompactionWithHFileLink type=DISABLED ttl=0 } at 1700470529313 (+406 ms)Consolidate snapshot: hbase-failsafe-snaptb-1700470517570-1700470528892 at 1700470529745 (+432 ms)Loading Region manifests for hbase-failsafe-snaptb-1700470517570-1700470528892 at 1700470529745Writing data manifest for hbase-failsafe-snaptb-1700470517570-1700470528892 at 1700470529748 (+3 ms)Verifying snapshot: hbase-failsafe-snaptb-1700470517570-1700470528892 at 1700470530157 (+409 ms)Snapshot hbase-failsafe-snaptb-1700470517570-1700470528892 of table testCompactionWithHFileLink completed at 1700470530181 (+24 ms) 2023-11-20 08:55:30,182 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-20 08:55:30,184 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 1.2770 sec 2023-11-20 08:55:31,013 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-20 08:55:31,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1700470517570-1700470528892 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-20 08:55:31,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] snapshot.SnapshotManager(403): Snapshot '{ ss=hbase-failsafe-snaptb-1700470517570-1700470528892 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-11-20 08:55:31,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE:RESTORE_SNAPSHOT_PRE_OPERATION; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1700470517570" table: "testCompactionWithHFileLink" creation_time: 1700470517581 type: FLUSH version: 2 ttl: 0 ) 2023-11-20 08:55:31,059 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] snapshot.SnapshotManager(916): Restore snapshot=snaptb-1700470517570 as table=testCompactionWithHFileLink 2023-11-20 08:55:31,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-20 08:55:31,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-20 08:55:31,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-20 08:55:31,470 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-11-20 08:55:31,471 DEBUG [PEWorker-3] util.FSTableDescriptors(519): Deleted hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-11-20 08:55:31,471 INFO [PEWorker-3] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-11-20 08:55:31,472 INFO [PEWorker-3] procedure.RestoreSnapshotProcedure(384): Starting restore snapshot={ ss=snaptb-1700470517570 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-20 08:55:31,476 INFO [PEWorker-3] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "snaptb-1700470517570" table: "testCompactionWithHFileLink" creation_time: 1700470517581 type: FLUSH version: 2 ttl: 0 2023-11-20 08:55:31,477 DEBUG [PEWorker-3] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink 2023-11-20 08:55:31,482 DEBUG [PEWorker-3] snapshot.RestoreSnapshotHelper(797): found 3 regions for table=testCompactionWithHFileLink 2023-11-20 08:55:31,485 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311203f2ddcd6ed0c4bac80773506813aceec to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311203f2ddcd6ed0c4bac80773506813aceec 2023-11-20 08:55:31,486 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231120a9d3bd8e036e47b0bc598498c6a3774e to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231120a9d3bd8e036e47b0bc598498c6a3774e 2023-11-20 08:55:31,488 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023112003c670d8316d4132b99d5965589f3787 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023112003c670d8316d4132b99d5965589f3787 2023-11-20 08:55:31,488 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20231120f6195321ff784ce38b2bddfe7d5789b6 of snapshot=snaptb-1700470517570 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-20 08:55:31,491 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20231120f7517fe0ca684f6e92feb428804de37b of snapshot=snaptb-1700470517570 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-20 08:55:31,493 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20231120fa10b641104a46d0b823e14b92103359 of snapshot=snaptb-1700470517570 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-20 08:55:31,496 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20231120fcb9f5f048a143efb087851bd58889cb of snapshot=snaptb-1700470517570 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-20 08:55:31,499 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202311200b72f04ed9dd4745a7416f9fa3f787a3 of snapshot=snaptb-1700470517570 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-20 08:55:31,502 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c2023112043f1cb2484844d628527c6caeae200f2 of snapshot=snaptb-1700470517570 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-20 08:55:31,505 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20231120c8a666d226eb4104ad21c3355768bd45 of snapshot=snaptb-1700470517570 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-20 08:55:31,509 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20231120f43bf08d68b04c5a9298bb294a99ac9d of snapshot=snaptb-1700470517570 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-20 08:55:31,512 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e2023112071cf63e3fb3c40b0b53c32617f3340d7 of snapshot=snaptb-1700470517570 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-20 08:55:31,514 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e2023112078d310eea24740eba786d4ea973a0f92 of snapshot=snaptb-1700470517570 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-20 08:55:31,517 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20231120b8666ade0d124147b4c3e46c3763ef30 of snapshot=snaptb-1700470517570 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-20 08:55:31,521 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20231120c38961dec1a24a4fa49ebbccf556edd5 of snapshot=snaptb-1700470517570 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-20 08:55:31,526 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311204814a666a36f4f4e8fe6db88040d84d5_del to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311204814a666a36f4f4e8fe6db88040d84d5_del 2023-11-20 08:55:31,527 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311200ecdd649908243629a4ee307e36761fd_del to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311200ecdd649908243629a4ee307e36761fd_del 2023-11-20 08:55:31,528 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231120b7cb1e5487894c87aae2b07920f84156_del to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231120b7cb1e5487894c87aae2b07920f84156_del 2023-11-20 08:55:31,528 INFO [PEWorker-3] snapshot.RestoreSnapshotHelper(223): region to restore: 3c896a09e2b9659e521fbfa3f4c3a8b7 2023-11-20 08:55:31,528 INFO [PEWorker-3] snapshot.RestoreSnapshotHelper(223): region to restore: 85ad044c09ac7e7f46d086f5a2df28bd 2023-11-20 08:55:31,528 INFO [PEWorker-3] snapshot.RestoreSnapshotHelper(223): region to restore: c417fce1816d885109d4ed56f4041903 2023-11-20 08:55:31,532 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/52e4df4640ca47b7b7ae3e76723b1396 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/52e4df4640ca47b7b7ae3e76723b1396 2023-11-20 08:55:31,532 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/42fbaedc2d364ae49f9a4bd894028ca7 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/42fbaedc2d364ae49f9a4bd894028ca7 2023-11-20 08:55:31,533 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/4eae363c8ea44156a7a794a24bbdfcdc_SeqId_29_ to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/4eae363c8ea44156a7a794a24bbdfcdc_SeqId_29_ 2023-11-20 08:55:31,541 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/3f873b67318744edab220630159865d7_SeqId_29_ to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/3f873b67318744edab220630159865d7_SeqId_29_ 2023-11-20 08:55:31,541 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c7c38f61302543f6ab8b229d5a17e082 of snapshot=snaptb-1700470517570 to region=c417fce1816d885109d4ed56f4041903 table=testCompactionWithHFileLink 2023-11-20 08:55:31,541 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/963d00887e7947498904a9f4ebf5a112_SeqId_29_ to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/963d00887e7947498904a9f4ebf5a112_SeqId_29_ 2023-11-20 08:55:31,541 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink fa4d45a0dc0d44169e48cf27b5b4a06c of snapshot=snaptb-1700470517570 to region=3c896a09e2b9659e521fbfa3f4c3a8b7 table=testCompactionWithHFileLink 2023-11-20 08:55:31,541 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/02380f8ff7534e04bd6489d09f7ff6aa to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/02380f8ff7534e04bd6489d09f7ff6aa 2023-11-20 08:55:31,541 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 2bc034df4b214a4f85aa27534763b0da of snapshot=snaptb-1700470517570 to region=85ad044c09ac7e7f46d086f5a2df28bd table=testCompactionWithHFileLink 2023-11-20 08:55:31,561 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 1e83151507e6498591a9f13142d5a99a of snapshot=snaptb-1700470517570 to region=3c896a09e2b9659e521fbfa3f4c3a8b7 table=testCompactionWithHFileLink 2023-11-20 08:55:31,561 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink ec23d5df0abb4729ad90a33a90eb66c5 of snapshot=snaptb-1700470517570 to region=85ad044c09ac7e7f46d086f5a2df28bd table=testCompactionWithHFileLink 2023-11-20 08:55:31,568 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink e1f18fc59fb04513b77458a0ca57c34c of snapshot=snaptb-1700470517570 to region=c417fce1816d885109d4ed56f4041903 table=testCompactionWithHFileLink 2023-11-20 08:55:31,572 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink cf739c3495224991832bce73e7fff537 of snapshot=snaptb-1700470517570 to region=3c896a09e2b9659e521fbfa3f4c3a8b7 table=testCompactionWithHFileLink 2023-11-20 08:55:31,572 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 2a3fabf5d99147039126dbb098f308b8 of snapshot=snaptb-1700470517570 to region=85ad044c09ac7e7f46d086f5a2df28bd table=testCompactionWithHFileLink 2023-11-20 08:55:31,574 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 1936fbed6edb4fbf92c2a753036428d6 of snapshot=snaptb-1700470517570 to region=c417fce1816d885109d4ed56f4041903 table=testCompactionWithHFileLink 2023-11-20 08:55:31,576 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink b350610b1eb2407d9ed82182edee91dc of snapshot=snaptb-1700470517570 to region=85ad044c09ac7e7f46d086f5a2df28bd table=testCompactionWithHFileLink 2023-11-20 08:55:31,576 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink baa9f3cddff746cda812640b187caf04 of snapshot=snaptb-1700470517570 to region=3c896a09e2b9659e521fbfa3f4c3a8b7 table=testCompactionWithHFileLink 2023-11-20 08:55:31,578 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 1bda7aa2c54340fdb0f8c892a0fc0cc4 of snapshot=snaptb-1700470517570 to region=c417fce1816d885109d4ed56f4041903 table=testCompactionWithHFileLink 2023-11-20 08:55:31,581 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family2/333b1ec1b6eb46fa8831bea68ceb6588 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family2/333b1ec1b6eb46fa8831bea68ceb6588 2023-11-20 08:55:31,581 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 49c61ac548624234b02ef1d4611f4e9e of snapshot=snaptb-1700470517570 to region=85ad044c09ac7e7f46d086f5a2df28bd table=testCompactionWithHFileLink 2023-11-20 08:55:31,582 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family2/5be5fa4774c7438c890f5baa21cdc0bd to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family2/5be5fa4774c7438c890f5baa21cdc0bd 2023-11-20 08:55:31,582 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c58b680b02974ce3a6dfe6eb61247c8a of snapshot=snaptb-1700470517570 to region=3c896a09e2b9659e521fbfa3f4c3a8b7 table=testCompactionWithHFileLink 2023-11-20 08:55:31,583 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family2/0ec5ede0b4444d9eb0d5dbeb92b8a047 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family2/0ec5ede0b4444d9eb0d5dbeb92b8a047 2023-11-20 08:55:31,583 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 385ba0396fd141c2869c227cb1738afe of snapshot=snaptb-1700470517570 to region=c417fce1816d885109d4ed56f4041903 table=testCompactionWithHFileLink 2023-11-20 08:55:31,588 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 101b13c82a8e45e6aeeecdcf4631c167 of snapshot=snaptb-1700470517570 to region=85ad044c09ac7e7f46d086f5a2df28bd table=testCompactionWithHFileLink 2023-11-20 08:55:31,588 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink f352ce62aae04c87b30585be76110820 of snapshot=snaptb-1700470517570 to region=3c896a09e2b9659e521fbfa3f4c3a8b7 table=testCompactionWithHFileLink 2023-11-20 08:55:31,594 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 463ef75cff3349cfa57903e3803d583c of snapshot=snaptb-1700470517570 to region=c417fce1816d885109d4ed56f4041903 table=testCompactionWithHFileLink 2023-11-20 08:55:31,595 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 001fcf2941754af8b6f053118436cda2 of snapshot=snaptb-1700470517570 to region=85ad044c09ac7e7f46d086f5a2df28bd table=testCompactionWithHFileLink 2023-11-20 08:55:31,596 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink f06094b14986481ea9ae6a16eeb26f98 of snapshot=snaptb-1700470517570 to region=3c896a09e2b9659e521fbfa3f4c3a8b7 table=testCompactionWithHFileLink 2023-11-20 08:55:31,597 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 70b789bd0e2740bc862576c291870517 of snapshot=snaptb-1700470517570 to region=c417fce1816d885109d4ed56f4041903 table=testCompactionWithHFileLink 2023-11-20 08:55:31,599 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink abc8a0d5f47f4a589343d123fceadbce of snapshot=snaptb-1700470517570 to region=85ad044c09ac7e7f46d086f5a2df28bd table=testCompactionWithHFileLink 2023-11-20 08:55:31,600 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink b21ad80b056243bb82c80545bb922fa9 of snapshot=snaptb-1700470517570 to region=3c896a09e2b9659e521fbfa3f4c3a8b7 table=testCompactionWithHFileLink 2023-11-20 08:55:31,601 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink a4f7262c26c74982adfa4b452ffa6921 of snapshot=snaptb-1700470517570 to region=c417fce1816d885109d4ed56f4041903 table=testCompactionWithHFileLink 2023-11-20 08:55:31,604 INFO [PEWorker-3] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "snaptb-1700470517570" table: "testCompactionWithHFileLink" creation_time: 1700470517581 type: FLUSH version: 2 ttl: 0 2023-11-20 08:55:31,605 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1700470531605"}]},"ts":"9223372036854775807"} 2023-11-20 08:55:31,605 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1700470531605"}]},"ts":"9223372036854775807"} 2023-11-20 08:55:31,605 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1700470531605"}]},"ts":"9223372036854775807"} 2023-11-20 08:55:31,607 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-11-20 08:55:31,607 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 3c896a09e2b9659e521fbfa3f4c3a8b7, NAME => 'testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => 85ad044c09ac7e7f46d086f5a2df28bd, NAME => 'testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => c417fce1816d885109d4ed56f4041903, NAME => 'testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903.', STARTKEY => '2', ENDKEY => ''}] 2023-11-20 08:55:31,607 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700470531606"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700470531606"}]},"ts":"1700470531606"} 2023-11-20 08:55:31,607 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700470531606"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700470531606"}]},"ts":"1700470531606"} 2023-11-20 08:55:31,607 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700470531606"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700470531606"}]},"ts":"1700470531606"} 2023-11-20 08:55:31,609 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-20 08:55:31,609 INFO [PEWorker-3] hbase.MetaTableAccessor(1810): Overwritten 3 regions to Meta 2023-11-20 08:55:31,609 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1811): Overwritten regions: [{ENCODED => 3c896a09e2b9659e521fbfa3f4c3a8b7, NAME => 'testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => 85ad044c09ac7e7f46d086f5a2df28bd, NAME => 'testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => c417fce1816d885109d4ed56f4041903, NAME => 'testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903.', STARTKEY => '2', ENDKEY => ''}] 2023-11-20 08:55:31,609 INFO [PEWorker-3] procedure.RestoreSnapshotProcedure(457): Restore snapshot={ ss=snaptb-1700470517570 table=testCompactionWithHFileLink type=FLUSH ttl=0 } on table=testCompactionWithHFileLink completed! 2023-11-20 08:55:31,611 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1700470517570" table: "testCompactionWithHFileLink" creation_time: 1700470517581 type: FLUSH version: 2 ttl: 0 ) in 560 msec 2023-11-20 08:55:31,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-20 08:55:31,665 INFO [Listener at localhost/43513] client.HBaseAdmin$TableFuture(3541): Operation: MODIFY, Table Name: default:testCompactionWithHFileLink, procId: 96 completed 2023-11-20 08:55:31,665 INFO [Listener at localhost/43513] client.HBaseAdmin(2618): Deleting restore-failsafe snapshot: hbase-failsafe-snaptb-1700470517570-1700470528892 2023-11-20 08:55:31,669 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "hbase-failsafe-snaptb-1700470517570-1700470528892" 2023-11-20 08:55:31,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] snapshot.SnapshotManager(335): Deleting snapshot: hbase-failsafe-snaptb-1700470517570-1700470528892 2023-11-20 08:55:31,674 INFO [Listener at localhost/43513] client.HBaseAdmin$14(830): Started enable of testCompactionWithHFileLink 2023-11-20 08:55:31,678 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.HMaster$10(2385): Client=jenkins//172.31.14.131 enable testCompactionWithHFileLink 2023-11-20 08:55:31,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE:ENABLE_TABLE_PREPARE; EnableTableProcedure table=testCompactionWithHFileLink 2023-11-20 08:55:31,686 INFO [PEWorker-5] procedure.EnableTableProcedure(296): Attempting to enable the table testCompactionWithHFileLink 2023-11-20 08:55:31,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-20 08:55:31,686 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700470531686"}]},"ts":"1700470531686"} 2023-11-20 08:55:31,687 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-11-20 08:55:31,689 DEBUG [PEWorker-5] procedure.EnableTableProcedure(107): No change in number of region replicas (configuredReplicaCount=1); assigning. 2023-11-20 08:55:31,689 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=85ad044c09ac7e7f46d086f5a2df28bd, ASSIGN}, {pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=3c896a09e2b9659e521fbfa3f4c3a8b7, ASSIGN}, {pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c417fce1816d885109d4ed56f4041903, ASSIGN}] 2023-11-20 08:55:31,690 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=85ad044c09ac7e7f46d086f5a2df28bd, ASSIGN 2023-11-20 08:55:31,690 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c417fce1816d885109d4ed56f4041903, ASSIGN 2023-11-20 08:55:31,691 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=3c896a09e2b9659e521fbfa3f4c3a8b7, ASSIGN 2023-11-20 08:55:31,691 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=85ad044c09ac7e7f46d086f5a2df28bd, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-11-20 08:55:31,691 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=3c896a09e2b9659e521fbfa3f4c3a8b7, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-11-20 08:55:31,691 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c417fce1816d885109d4ed56f4041903, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-11-20 08:55:31,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-20 08:55:31,843 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=85ad044c09ac7e7f46d086f5a2df28bd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:31,843 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=3c896a09e2b9659e521fbfa3f4c3a8b7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:31,843 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=c417fce1816d885109d4ed56f4041903, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:31,843 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700470531843"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700470531843"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700470531843"}]},"ts":"1700470531843"} 2023-11-20 08:55:31,843 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700470531843"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700470531843"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700470531843"}]},"ts":"1700470531843"} 2023-11-20 08:55:31,843 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700470531843"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700470531843"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700470531843"}]},"ts":"1700470531843"} 2023-11-20 08:55:31,844 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=101, ppid=98, state=RUNNABLE; OpenRegionProcedure 85ad044c09ac7e7f46d086f5a2df28bd, server=jenkins-hbase4.apache.org,38491,1700470412215}] 2023-11-20 08:55:31,846 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=99, state=RUNNABLE; OpenRegionProcedure 3c896a09e2b9659e521fbfa3f4c3a8b7, server=jenkins-hbase4.apache.org,38491,1700470412215}] 2023-11-20 08:55:31,846 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; OpenRegionProcedure c417fce1816d885109d4ed56f4041903, server=jenkins-hbase4.apache.org,38491,1700470412215}] 2023-11-20 08:55:31,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-20 08:55:31,996 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:31,999 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd. 2023-11-20 08:55:31,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 85ad044c09ac7e7f46d086f5a2df28bd, NAME => 'testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd.', STARTKEY => '', ENDKEY => '1'} 2023-11-20 08:55:31,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 85ad044c09ac7e7f46d086f5a2df28bd 2023-11-20 08:55:31,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-20 08:55:31,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 85ad044c09ac7e7f46d086f5a2df28bd 2023-11-20 08:55:31,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 85ad044c09ac7e7f46d086f5a2df28bd 2023-11-20 08:55:32,000 INFO [StoreOpener-85ad044c09ac7e7f46d086f5a2df28bd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 85ad044c09ac7e7f46d086f5a2df28bd 2023-11-20 08:55:32,001 DEBUG [StoreOpener-85ad044c09ac7e7f46d086f5a2df28bd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1 2023-11-20 08:55:32,001 DEBUG [StoreOpener-85ad044c09ac7e7f46d086f5a2df28bd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1 2023-11-20 08:55:32,002 INFO [StoreOpener-85ad044c09ac7e7f46d086f5a2df28bd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 85ad044c09ac7e7f46d086f5a2df28bd columnFamilyName family1 2023-11-20 08:55:32,010 DEBUG [StoreOpener-85ad044c09ac7e7f46d086f5a2df28bd-1] regionserver.HStore(539): loaded hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/testCompactionWithHFileLink=85ad044c09ac7e7f46d086f5a2df28bd-2a3fabf5d99147039126dbb098f308b8 2023-11-20 08:55:32,015 DEBUG [StoreOpener-85ad044c09ac7e7f46d086f5a2df28bd-1] regionserver.HStore(539): loaded hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/testCompactionWithHFileLink=85ad044c09ac7e7f46d086f5a2df28bd-2bc034df4b214a4f85aa27534763b0da 2023-11-20 08:55:32,020 DEBUG [StoreOpener-85ad044c09ac7e7f46d086f5a2df28bd-1] regionserver.HStore(539): loaded hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/testCompactionWithHFileLink=85ad044c09ac7e7f46d086f5a2df28bd-b350610b1eb2407d9ed82182edee91dc 2023-11-20 08:55:32,024 DEBUG [StoreOpener-85ad044c09ac7e7f46d086f5a2df28bd-1] regionserver.HStore(539): loaded hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/testCompactionWithHFileLink=85ad044c09ac7e7f46d086f5a2df28bd-ec23d5df0abb4729ad90a33a90eb66c5 2023-11-20 08:55:32,024 INFO [StoreOpener-85ad044c09ac7e7f46d086f5a2df28bd-1] regionserver.HStore(310): Store=85ad044c09ac7e7f46d086f5a2df28bd/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-20 08:55:32,025 INFO [StoreOpener-85ad044c09ac7e7f46d086f5a2df28bd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 85ad044c09ac7e7f46d086f5a2df28bd 2023-11-20 08:55:32,025 DEBUG [StoreOpener-85ad044c09ac7e7f46d086f5a2df28bd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family2 2023-11-20 08:55:32,025 DEBUG [StoreOpener-85ad044c09ac7e7f46d086f5a2df28bd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family2 2023-11-20 08:55:32,026 INFO [StoreOpener-85ad044c09ac7e7f46d086f5a2df28bd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 85ad044c09ac7e7f46d086f5a2df28bd columnFamilyName family2 2023-11-20 08:55:32,032 DEBUG [StoreOpener-85ad044c09ac7e7f46d086f5a2df28bd-1] regionserver.HStore(539): loaded hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family2/testCompactionWithHFileLink=85ad044c09ac7e7f46d086f5a2df28bd-001fcf2941754af8b6f053118436cda2 2023-11-20 08:55:32,037 DEBUG [StoreOpener-85ad044c09ac7e7f46d086f5a2df28bd-1] regionserver.HStore(539): loaded hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family2/testCompactionWithHFileLink=85ad044c09ac7e7f46d086f5a2df28bd-101b13c82a8e45e6aeeecdcf4631c167 2023-11-20 08:55:32,042 DEBUG [StoreOpener-85ad044c09ac7e7f46d086f5a2df28bd-1] regionserver.HStore(539): loaded hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family2/testCompactionWithHFileLink=85ad044c09ac7e7f46d086f5a2df28bd-49c61ac548624234b02ef1d4611f4e9e 2023-11-20 08:55:32,047 DEBUG [StoreOpener-85ad044c09ac7e7f46d086f5a2df28bd-1] regionserver.HStore(539): loaded hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family2/testCompactionWithHFileLink=85ad044c09ac7e7f46d086f5a2df28bd-abc8a0d5f47f4a589343d123fceadbce 2023-11-20 08:55:32,047 INFO [StoreOpener-85ad044c09ac7e7f46d086f5a2df28bd-1] regionserver.HStore(310): Store=85ad044c09ac7e7f46d086f5a2df28bd/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-20 08:55:32,048 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd 2023-11-20 08:55:32,049 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd 2023-11-20 08:55:32,050 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-20 08:55:32,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 85ad044c09ac7e7f46d086f5a2df28bd 2023-11-20 08:55:32,052 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 85ad044c09ac7e7f46d086f5a2df28bd; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64148679, jitterRate=-0.044110193848609924}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-20 08:55:32,052 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 85ad044c09ac7e7f46d086f5a2df28bd: 2023-11-20 08:55:32,053 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd., pid=101, masterSystemTime=1700470531996 2023-11-20 08:55:32,053 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-20 08:55:32,053 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-11-20 08:55:32,053 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-20 08:55:32,053 DEBUG [RS:0;jenkins-hbase4:38491-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-20 08:55:32,055 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd. 2023-11-20 08:55:32,055 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd. 2023-11-20 08:55:32,055 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903. 2023-11-20 08:55:32,055 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c417fce1816d885109d4ed56f4041903, NAME => 'testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903.', STARTKEY => '2', ENDKEY => ''} 2023-11-20 08:55:32,055 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=85ad044c09ac7e7f46d086f5a2df28bd, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:32,055 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700470532055"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700470532055"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700470532055"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700470532055"}]},"ts":"1700470532055"} 2023-11-20 08:55:32,055 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink c417fce1816d885109d4ed56f4041903 2023-11-20 08:55:32,056 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-20 08:55:32,056 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c417fce1816d885109d4ed56f4041903 2023-11-20 08:55:32,056 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c417fce1816d885109d4ed56f4041903 2023-11-20 08:55:32,056 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-20 08:55:32,056 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HStore(1912): 85ad044c09ac7e7f46d086f5a2df28bd/family1 is initiating minor compaction (all files) 2023-11-20 08:55:32,056 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 85ad044c09ac7e7f46d086f5a2df28bd/family1 in testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd. 2023-11-20 08:55:32,056 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/testCompactionWithHFileLink=85ad044c09ac7e7f46d086f5a2df28bd-2bc034df4b214a4f85aa27534763b0da, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/testCompactionWithHFileLink=85ad044c09ac7e7f46d086f5a2df28bd-ec23d5df0abb4729ad90a33a90eb66c5, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/testCompactionWithHFileLink=85ad044c09ac7e7f46d086f5a2df28bd-2a3fabf5d99147039126dbb098f308b8, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/testCompactionWithHFileLink=85ad044c09ac7e7f46d086f5a2df28bd-b350610b1eb2407d9ed82182edee91dc] into tmpdir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/.tmp, totalSize=21.6 K 2023-11-20 08:55:32,057 DEBUG [RS:0;jenkins-hbase4:38491-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-20 08:55:32,057 DEBUG [RS:0;jenkins-hbase4:38491-longCompactions-0] regionserver.HStore(1912): 85ad044c09ac7e7f46d086f5a2df28bd/family2 is initiating minor compaction (all files) 2023-11-20 08:55:32,057 INFO [RS:0;jenkins-hbase4:38491-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 85ad044c09ac7e7f46d086f5a2df28bd/family2 in testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd. 2023-11-20 08:55:32,057 INFO [RS:0;jenkins-hbase4:38491-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family2/testCompactionWithHFileLink=85ad044c09ac7e7f46d086f5a2df28bd-49c61ac548624234b02ef1d4611f4e9e, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family2/testCompactionWithHFileLink=85ad044c09ac7e7f46d086f5a2df28bd-101b13c82a8e45e6aeeecdcf4631c167, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family2/testCompactionWithHFileLink=85ad044c09ac7e7f46d086f5a2df28bd-001fcf2941754af8b6f053118436cda2, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family2/testCompactionWithHFileLink=85ad044c09ac7e7f46d086f5a2df28bd-abc8a0d5f47f4a589343d123fceadbce] into tmpdir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/.tmp, totalSize=20.4 K 2023-11-20 08:55:32,058 INFO [StoreOpener-c417fce1816d885109d4ed56f4041903-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c417fce1816d885109d4ed56f4041903 2023-11-20 08:55:32,058 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=85ad044c09ac7e7f46d086f5a2df28bd-2bc034df4b214a4f85aa27534763b0da, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700470510333 2023-11-20 08:55:32,058 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=101, resume processing ppid=98 2023-11-20 08:55:32,058 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=98, state=SUCCESS; OpenRegionProcedure 85ad044c09ac7e7f46d086f5a2df28bd, server=jenkins-hbase4.apache.org,38491,1700470412215 in 213 msec 2023-11-20 08:55:32,059 DEBUG [RS:0;jenkins-hbase4:38491-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=85ad044c09ac7e7f46d086f5a2df28bd-49c61ac548624234b02ef1d4611f4e9e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700470510333 2023-11-20 08:55:32,059 DEBUG [StoreOpener-c417fce1816d885109d4ed56f4041903-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1 2023-11-20 08:55:32,059 DEBUG [StoreOpener-c417fce1816d885109d4ed56f4041903-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1 2023-11-20 08:55:32,059 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=85ad044c09ac7e7f46d086f5a2df28bd-ec23d5df0abb4729ad90a33a90eb66c5, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700470512170 2023-11-20 08:55:32,059 INFO [StoreOpener-c417fce1816d885109d4ed56f4041903-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c417fce1816d885109d4ed56f4041903 columnFamilyName family1 2023-11-20 08:55:32,059 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=98, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=85ad044c09ac7e7f46d086f5a2df28bd, ASSIGN in 369 msec 2023-11-20 08:55:32,060 DEBUG [RS:0;jenkins-hbase4:38491-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=85ad044c09ac7e7f46d086f5a2df28bd-101b13c82a8e45e6aeeecdcf4631c167, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700470512170 2023-11-20 08:55:32,060 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=85ad044c09ac7e7f46d086f5a2df28bd-2a3fabf5d99147039126dbb098f308b8, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700470513975 2023-11-20 08:55:32,061 DEBUG [RS:0;jenkins-hbase4:38491-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=85ad044c09ac7e7f46d086f5a2df28bd-001fcf2941754af8b6f053118436cda2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700470513975 2023-11-20 08:55:32,061 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=85ad044c09ac7e7f46d086f5a2df28bd-b350610b1eb2407d9ed82182edee91dc, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700470515774 2023-11-20 08:55:32,063 DEBUG [RS:0;jenkins-hbase4:38491-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=85ad044c09ac7e7f46d086f5a2df28bd-abc8a0d5f47f4a589343d123fceadbce, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700470515774 2023-11-20 08:55:32,080 DEBUG [StoreOpener-c417fce1816d885109d4ed56f4041903-1] regionserver.HStore(539): loaded hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/testCompactionWithHFileLink=c417fce1816d885109d4ed56f4041903-1936fbed6edb4fbf92c2a753036428d6 2023-11-20 08:55:32,088 DEBUG [StoreOpener-c417fce1816d885109d4ed56f4041903-1] regionserver.HStore(539): loaded hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/testCompactionWithHFileLink=c417fce1816d885109d4ed56f4041903-1bda7aa2c54340fdb0f8c892a0fc0cc4 2023-11-20 08:55:32,095 DEBUG [StoreOpener-c417fce1816d885109d4ed56f4041903-1] regionserver.HStore(539): loaded hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/testCompactionWithHFileLink=c417fce1816d885109d4ed56f4041903-c7c38f61302543f6ab8b229d5a17e082 2023-11-20 08:55:32,097 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] throttle.PressureAwareThroughputController(145): 85ad044c09ac7e7f46d086f5a2df28bd#family1#compaction#113 average throughput is 0.78 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 50.00 MB/second 2023-11-20 08:55:32,101 INFO [RS:0;jenkins-hbase4:38491-longCompactions-0] throttle.PressureAwareThroughputController(145): 85ad044c09ac7e7f46d086f5a2df28bd#family2#compaction#114 average throughput is 0.23 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-20 08:55:32,104 DEBUG [StoreOpener-c417fce1816d885109d4ed56f4041903-1] regionserver.HStore(539): loaded hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/testCompactionWithHFileLink=c417fce1816d885109d4ed56f4041903-e1f18fc59fb04513b77458a0ca57c34c 2023-11-20 08:55:32,105 INFO [StoreOpener-c417fce1816d885109d4ed56f4041903-1] regionserver.HStore(310): Store=c417fce1816d885109d4ed56f4041903/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-20 08:55:32,105 INFO [StoreOpener-c417fce1816d885109d4ed56f4041903-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region c417fce1816d885109d4ed56f4041903 2023-11-20 08:55:32,106 DEBUG [StoreOpener-c417fce1816d885109d4ed56f4041903-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family2 2023-11-20 08:55:32,106 DEBUG [StoreOpener-c417fce1816d885109d4ed56f4041903-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family2 2023-11-20 08:55:32,106 INFO [StoreOpener-c417fce1816d885109d4ed56f4041903-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c417fce1816d885109d4ed56f4041903 columnFamilyName family2 2023-11-20 08:55:32,114 DEBUG [StoreOpener-c417fce1816d885109d4ed56f4041903-1] regionserver.HStore(539): loaded hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family2/testCompactionWithHFileLink=c417fce1816d885109d4ed56f4041903-385ba0396fd141c2869c227cb1738afe 2023-11-20 08:55:32,118 DEBUG [StoreOpener-c417fce1816d885109d4ed56f4041903-1] regionserver.HStore(539): loaded hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family2/testCompactionWithHFileLink=c417fce1816d885109d4ed56f4041903-463ef75cff3349cfa57903e3803d583c 2023-11-20 08:55:32,121 DEBUG [StoreOpener-c417fce1816d885109d4ed56f4041903-1] regionserver.HStore(539): loaded hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family2/testCompactionWithHFileLink=c417fce1816d885109d4ed56f4041903-70b789bd0e2740bc862576c291870517 2023-11-20 08:55:32,125 DEBUG [StoreOpener-c417fce1816d885109d4ed56f4041903-1] regionserver.HStore(539): loaded hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family2/testCompactionWithHFileLink=c417fce1816d885109d4ed56f4041903-a4f7262c26c74982adfa4b452ffa6921 2023-11-20 08:55:32,125 INFO [StoreOpener-c417fce1816d885109d4ed56f4041903-1] regionserver.HStore(310): Store=c417fce1816d885109d4ed56f4041903/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-20 08:55:32,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903 2023-11-20 08:55:32,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903 2023-11-20 08:55:32,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-20 08:55:32,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c417fce1816d885109d4ed56f4041903 2023-11-20 08:55:32,129 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c417fce1816d885109d4ed56f4041903; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65712970, jitterRate=-0.02080044150352478}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-20 08:55:32,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c417fce1816d885109d4ed56f4041903: 2023-11-20 08:55:32,130 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903., pid=103, masterSystemTime=1700470531996 2023-11-20 08:55:32,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-11-20 08:55:32,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-11-20 08:55:32,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903. 2023-11-20 08:55:32,132 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903. 2023-11-20 08:55:32,132 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7. 2023-11-20 08:55:32,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3c896a09e2b9659e521fbfa3f4c3a8b7, NAME => 'testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7.', STARTKEY => '1', ENDKEY => '2'} 2023-11-20 08:55:32,132 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=c417fce1816d885109d4ed56f4041903, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:32,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 3c896a09e2b9659e521fbfa3f4c3a8b7 2023-11-20 08:55:32,132 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700470532132"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700470532132"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700470532132"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700470532132"}]},"ts":"1700470532132"} 2023-11-20 08:55:32,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-20 08:55:32,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3c896a09e2b9659e521fbfa3f4c3a8b7 2023-11-20 08:55:32,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3c896a09e2b9659e521fbfa3f4c3a8b7 2023-11-20 08:55:32,133 INFO [StoreOpener-3c896a09e2b9659e521fbfa3f4c3a8b7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 3c896a09e2b9659e521fbfa3f4c3a8b7 2023-11-20 08:55:32,134 DEBUG [StoreOpener-3c896a09e2b9659e521fbfa3f4c3a8b7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1 2023-11-20 08:55:32,134 DEBUG [StoreOpener-3c896a09e2b9659e521fbfa3f4c3a8b7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1 2023-11-20 08:55:32,135 INFO [StoreOpener-3c896a09e2b9659e521fbfa3f4c3a8b7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3c896a09e2b9659e521fbfa3f4c3a8b7 columnFamilyName family1 2023-11-20 08:55:32,135 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=100 2023-11-20 08:55:32,135 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=100, state=SUCCESS; OpenRegionProcedure c417fce1816d885109d4ed56f4041903, server=jenkins-hbase4.apache.org,38491,1700470412215 in 287 msec 2023-11-20 08:55:32,136 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c417fce1816d885109d4ed56f4041903, ASSIGN in 446 msec 2023-11-20 08:55:32,141 DEBUG [StoreOpener-3c896a09e2b9659e521fbfa3f4c3a8b7-1] regionserver.HStore(539): loaded hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/testCompactionWithHFileLink=3c896a09e2b9659e521fbfa3f4c3a8b7-1e83151507e6498591a9f13142d5a99a 2023-11-20 08:55:32,146 DEBUG [StoreOpener-3c896a09e2b9659e521fbfa3f4c3a8b7-1] regionserver.HStore(539): loaded hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/testCompactionWithHFileLink=3c896a09e2b9659e521fbfa3f4c3a8b7-baa9f3cddff746cda812640b187caf04 2023-11-20 08:55:32,151 DEBUG [StoreOpener-3c896a09e2b9659e521fbfa3f4c3a8b7-1] regionserver.HStore(539): loaded hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/testCompactionWithHFileLink=3c896a09e2b9659e521fbfa3f4c3a8b7-cf739c3495224991832bce73e7fff537 2023-11-20 08:55:32,156 DEBUG [StoreOpener-3c896a09e2b9659e521fbfa3f4c3a8b7-1] regionserver.HStore(539): loaded hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/testCompactionWithHFileLink=3c896a09e2b9659e521fbfa3f4c3a8b7-fa4d45a0dc0d44169e48cf27b5b4a06c 2023-11-20 08:55:32,157 INFO [StoreOpener-3c896a09e2b9659e521fbfa3f4c3a8b7-1] regionserver.HStore(310): Store=3c896a09e2b9659e521fbfa3f4c3a8b7/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-20 08:55:32,157 INFO [StoreOpener-3c896a09e2b9659e521fbfa3f4c3a8b7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 3c896a09e2b9659e521fbfa3f4c3a8b7 2023-11-20 08:55:32,158 DEBUG [StoreOpener-3c896a09e2b9659e521fbfa3f4c3a8b7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family2 2023-11-20 08:55:32,158 DEBUG [StoreOpener-3c896a09e2b9659e521fbfa3f4c3a8b7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family2 2023-11-20 08:55:32,158 INFO [StoreOpener-3c896a09e2b9659e521fbfa3f4c3a8b7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3c896a09e2b9659e521fbfa3f4c3a8b7 columnFamilyName family2 2023-11-20 08:55:32,168 DEBUG [StoreOpener-3c896a09e2b9659e521fbfa3f4c3a8b7-1] regionserver.HStore(539): loaded hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family2/testCompactionWithHFileLink=3c896a09e2b9659e521fbfa3f4c3a8b7-b21ad80b056243bb82c80545bb922fa9 2023-11-20 08:55:32,174 DEBUG [StoreOpener-3c896a09e2b9659e521fbfa3f4c3a8b7-1] regionserver.HStore(539): loaded hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family2/testCompactionWithHFileLink=3c896a09e2b9659e521fbfa3f4c3a8b7-c58b680b02974ce3a6dfe6eb61247c8a 2023-11-20 08:55:32,179 DEBUG [StoreOpener-3c896a09e2b9659e521fbfa3f4c3a8b7-1] regionserver.HStore(539): loaded hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family2/testCompactionWithHFileLink=3c896a09e2b9659e521fbfa3f4c3a8b7-f06094b14986481ea9ae6a16eeb26f98 2023-11-20 08:55:32,185 DEBUG [StoreOpener-3c896a09e2b9659e521fbfa3f4c3a8b7-1] regionserver.HStore(539): loaded hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family2/testCompactionWithHFileLink=3c896a09e2b9659e521fbfa3f4c3a8b7-f352ce62aae04c87b30585be76110820 2023-11-20 08:55:32,185 INFO [StoreOpener-3c896a09e2b9659e521fbfa3f4c3a8b7-1] regionserver.HStore(310): Store=3c896a09e2b9659e521fbfa3f4c3a8b7/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-20 08:55:32,186 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7 2023-11-20 08:55:32,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7 2023-11-20 08:55:32,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-20 08:55:32,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3c896a09e2b9659e521fbfa3f4c3a8b7 2023-11-20 08:55:32,190 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3c896a09e2b9659e521fbfa3f4c3a8b7; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59499524, jitterRate=-0.11338800191879272}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-20 08:55:32,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3c896a09e2b9659e521fbfa3f4c3a8b7: 2023-11-20 08:55:32,190 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7., pid=102, masterSystemTime=1700470531996 2023-11-20 08:55:32,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-11-20 08:55:32,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-11-20 08:55:32,191 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7. 2023-11-20 08:55:32,191 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7. 2023-11-20 08:55:32,192 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=3c896a09e2b9659e521fbfa3f4c3a8b7, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:32,192 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700470532192"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700470532192"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700470532192"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700470532192"}]},"ts":"1700470532192"} 2023-11-20 08:55:32,195 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=99 2023-11-20 08:55:32,195 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=99, state=SUCCESS; OpenRegionProcedure 3c896a09e2b9659e521fbfa3f4c3a8b7, server=jenkins-hbase4.apache.org,38491,1700470412215 in 348 msec 2023-11-20 08:55:32,197 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=99, resume processing ppid=97 2023-11-20 08:55:32,197 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=99, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=3c896a09e2b9659e521fbfa3f4c3a8b7, ASSIGN in 506 msec 2023-11-20 08:55:32,198 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700470532197"}]},"ts":"1700470532197"} 2023-11-20 08:55:32,199 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-11-20 08:55:32,201 INFO [PEWorker-3] procedure.EnableTableProcedure(310): Table 'testCompactionWithHFileLink' was successfully enabled. 2023-11-20 08:55:32,202 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; EnableTableProcedure table=testCompactionWithHFileLink in 522 msec 2023-11-20 08:55:32,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-20 08:55:32,289 INFO [Listener at localhost/43513] client.HBaseAdmin$TableFuture(3541): Operation: ENABLE, Table Name: default:testCompactionWithHFileLink, procId: 97 completed 2023-11-20 08:55:32,306 DEBUG [Listener at localhost/43513] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-20 08:55:32,317 DEBUG [Listener at localhost/43513] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-20 08:55:32,327 DEBUG [Listener at localhost/43513] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-20 08:55:32,328 DEBUG [Listener at localhost/43513] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-20 08:55:32,333 INFO [Listener at localhost/43513] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-20 08:55:32,347 INFO [Listener at localhost/43513] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-11-20 08:55:32,347 INFO [Listener at localhost/43513] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testCompactionWithHFileLink' column='family1' 2023-11-20 08:55:32,348 DEBUG [Listener at localhost/43513] zookeeper.ReadOnlyZKClient(139): Connect 0x3447fbd5 to 127.0.0.1:64635 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-20 08:55:32,352 DEBUG [Listener at localhost/43513] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@64d9abc1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-20 08:55:32,353 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231120 for table='testCompactionWithHFileLink' and column='family1' 2023-11-20 08:55:32,353 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231120 for table='testCompactionWithHFileLink' and column='family1' 2023-11-20 08:55:32,353 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231120 for table='testCompactionWithHFileLink' and column='family1' 2023-11-20 08:55:32,436 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231120aef39119914949f2826ca6eb8bb3296b to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231120aef39119914949f2826ca6eb8bb3296b 2023-11-20 08:55:32,437 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231120 table='testCompactionWithHFileLink' column='family1' 2023-11-20 08:55:32,449 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-20 08:55:32,452 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43966, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-20 08:55:32,458 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-20 08:55:32,460 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41644, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-20 08:55:32,468 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231120/family1/115d08779303457ba8de6d46f93c84dd first=Optional[1\x00\x00\x00\x00] last=Optional[1\x00\x00\x00\x07] 2023-11-20 08:55:32,469 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7., hostname=jenkins-hbase4.apache.org,38491,1700470412215, seqNum=32 for row 1 with hfile group [{family1,hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231120/family1/115d08779303457ba8de6d46f93c84dd}] 2023-11-20 08:55:32,474 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HStore(763): Validating hfile at hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231120/family1/115d08779303457ba8de6d46f93c84dd for inclusion in 3c896a09e2b9659e521fbfa3f4c3a8b7/family1 2023-11-20 08:55:32,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x00 last=1\x00\x00\x00\x07 2023-11-20 08:55:32,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-20 08:55:32,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HRegion(2446): Flush status journal for 3c896a09e2b9659e521fbfa3f4c3a8b7: 2023-11-20 08:55:32,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231120/family1/115d08779303457ba8de6d46f93c84dd to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testCompactionWithHFileLink__ofb00mk5gimgi1j9ok43rd8m3lf5to7m90o5gu7dokpkjtk4vduemrlrhu3bnr7q/family1/115d08779303457ba8de6d46f93c84dd 2023-11-20 08:55:32,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testCompactionWithHFileLink__ofb00mk5gimgi1j9ok43rd8m3lf5to7m90o5gu7dokpkjtk4vduemrlrhu3bnr7q/family1/115d08779303457ba8de6d46f93c84dd as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/04fa25d3ea24485394969684374d7194_SeqId_34_ 2023-11-20 08:55:32,480 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HStore(849): Loaded HFile hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testCompactionWithHFileLink__ofb00mk5gimgi1j9ok43rd8m3lf5to7m90o5gu7dokpkjtk4vduemrlrhu3bnr7q/family1/115d08779303457ba8de6d46f93c84dd into 3c896a09e2b9659e521fbfa3f4c3a8b7/family1 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/04fa25d3ea24485394969684374d7194_SeqId_34_ - updating store file list. 2023-11-20 08:55:32,482 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HStore(882): Loaded HFile hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/04fa25d3ea24485394969684374d7194_SeqId_34_ into 3c896a09e2b9659e521fbfa3f4c3a8b7/family1 2023-11-20 08:55:32,482 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HStore(855): Successfully loaded hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testCompactionWithHFileLink__ofb00mk5gimgi1j9ok43rd8m3lf5to7m90o5gu7dokpkjtk4vduemrlrhu3bnr7q/family1/115d08779303457ba8de6d46f93c84dd into 3c896a09e2b9659e521fbfa3f4c3a8b7/family1 (new location: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/04fa25d3ea24485394969684374d7194_SeqId_34_) 2023-11-20 08:55:32,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testCompactionWithHFileLink__ofb00mk5gimgi1j9ok43rd8m3lf5to7m90o5gu7dokpkjtk4vduemrlrhu3bnr7q/family1/115d08779303457ba8de6d46f93c84dd 2023-11-20 08:55:32,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-20 08:55:32,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-11-20 08:55:32,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HStore(1912): 3c896a09e2b9659e521fbfa3f4c3a8b7/family1 is initiating minor compaction (all files) 2023-11-20 08:55:32,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@48b3aa89; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-11-20 08:55:32,487 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231120 table='testCompactionWithHFileLink' column='family1' 2023-11-20 08:55:32,487 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:55:32,489 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231120f6195321ff784ce38b2bddfe7d5789b6 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231120f6195321ff784ce38b2bddfe7d5789b6 2023-11-20 08:55:32,491 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231120f7517fe0ca684f6e92feb428804de37b to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231120f7517fe0ca684f6e92feb428804de37b 2023-11-20 08:55:32,492 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231120fa10b641104a46d0b823e14b92103359 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231120fa10b641104a46d0b823e14b92103359 2023-11-20 08:55:32,493 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231120fcb9f5f048a143efb087851bd58889cb to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231120fcb9f5f048a143efb087851bd58889cb 2023-11-20 08:55:32,493 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-20 08:55:32,493 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231120' 2023-11-20 08:55:32,493 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231120 for table='testCompactionWithHFileLink' and column='family1' 2023-11-20 08:55:32,521 DEBUG [RS:0;jenkins-hbase4:38491-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/.tmp/family2/abbe4f204c6946bd955fbf39f47be4f7 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family2/abbe4f204c6946bd955fbf39f47be4f7 2023-11-20 08:55:32,524 INFO [RS:0;jenkins-hbase4:38491-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 85ad044c09ac7e7f46d086f5a2df28bd/family2 of 85ad044c09ac7e7f46d086f5a2df28bd into abbe4f204c6946bd955fbf39f47be4f7(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-20 08:55:32,524 DEBUG [RS:0;jenkins-hbase4:38491-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 85ad044c09ac7e7f46d086f5a2df28bd: 2023-11-20 08:55:32,524 INFO [RS:0;jenkins-hbase4:38491-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd., storeName=85ad044c09ac7e7f46d086f5a2df28bd/family2, priority=12, startTime=1700470532053; duration=0sec 2023-11-20 08:55:32,525 DEBUG [RS:0;jenkins-hbase4:38491-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-11-20 08:55:32,525 INFO [RS:0;jenkins-hbase4:38491-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 3c896a09e2b9659e521fbfa3f4c3a8b7/family1 in testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7. 2023-11-20 08:55:32,525 INFO [RS:0;jenkins-hbase4:38491-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/testCompactionWithHFileLink=3c896a09e2b9659e521fbfa3f4c3a8b7-fa4d45a0dc0d44169e48cf27b5b4a06c, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/testCompactionWithHFileLink=3c896a09e2b9659e521fbfa3f4c3a8b7-1e83151507e6498591a9f13142d5a99a, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/testCompactionWithHFileLink=3c896a09e2b9659e521fbfa3f4c3a8b7-cf739c3495224991832bce73e7fff537, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/testCompactionWithHFileLink=3c896a09e2b9659e521fbfa3f4c3a8b7-baa9f3cddff746cda812640b187caf04, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/04fa25d3ea24485394969684374d7194_SeqId_34_] into tmpdir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/.tmp, totalSize=28.9 K 2023-11-20 08:55:32,525 DEBUG [RS:0;jenkins-hbase4:38491-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=3c896a09e2b9659e521fbfa3f4c3a8b7-fa4d45a0dc0d44169e48cf27b5b4a06c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700470510334 2023-11-20 08:55:32,526 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family2/testCompactionWithHFileLink=85ad044c09ac7e7f46d086f5a2df28bd-49c61ac548624234b02ef1d4611f4e9e, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family2/testCompactionWithHFileLink=85ad044c09ac7e7f46d086f5a2df28bd-101b13c82a8e45e6aeeecdcf4631c167, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family2/testCompactionWithHFileLink=85ad044c09ac7e7f46d086f5a2df28bd-001fcf2941754af8b6f053118436cda2, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family2/testCompactionWithHFileLink=85ad044c09ac7e7f46d086f5a2df28bd-abc8a0d5f47f4a589343d123fceadbce] to archive 2023-11-20 08:55:32,526 DEBUG [RS:0;jenkins-hbase4:38491-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=3c896a09e2b9659e521fbfa3f4c3a8b7-1e83151507e6498591a9f13142d5a99a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700470512170 2023-11-20 08:55:32,526 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:55:32,526 DEBUG [RS:0;jenkins-hbase4:38491-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=3c896a09e2b9659e521fbfa3f4c3a8b7-cf739c3495224991832bce73e7fff537, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700470513975 2023-11-20 08:55:32,527 DEBUG [RS:0;jenkins-hbase4:38491-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=3c896a09e2b9659e521fbfa3f4c3a8b7-baa9f3cddff746cda812640b187caf04, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700470515775 2023-11-20 08:55:32,527 DEBUG [RS:0;jenkins-hbase4:38491-longCompactions-0] compactions.Compactor(207): Compacting 04fa25d3ea24485394969684374d7194_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1700470510334 2023-11-20 08:55:32,528 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family2/testCompactionWithHFileLink=85ad044c09ac7e7f46d086f5a2df28bd-49c61ac548624234b02ef1d4611f4e9e to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family2/testCompactionWithHFileLink=85ad044c09ac7e7f46d086f5a2df28bd-49c61ac548624234b02ef1d4611f4e9e 2023-11-20 08:55:32,529 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family2/testCompactionWithHFileLink=85ad044c09ac7e7f46d086f5a2df28bd-101b13c82a8e45e6aeeecdcf4631c167 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family2/testCompactionWithHFileLink=85ad044c09ac7e7f46d086f5a2df28bd-101b13c82a8e45e6aeeecdcf4631c167 2023-11-20 08:55:32,530 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family2/testCompactionWithHFileLink=85ad044c09ac7e7f46d086f5a2df28bd-001fcf2941754af8b6f053118436cda2 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family2/testCompactionWithHFileLink=85ad044c09ac7e7f46d086f5a2df28bd-001fcf2941754af8b6f053118436cda2 2023-11-20 08:55:32,531 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family2/testCompactionWithHFileLink=85ad044c09ac7e7f46d086f5a2df28bd-abc8a0d5f47f4a589343d123fceadbce to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family2/testCompactionWithHFileLink=85ad044c09ac7e7f46d086f5a2df28bd-abc8a0d5f47f4a589343d123fceadbce 2023-11-20 08:55:32,540 INFO [RS:0;jenkins-hbase4:38491-longCompactions-0] throttle.PressureAwareThroughputController(145): 3c896a09e2b9659e521fbfa3f4c3a8b7#family1#compaction#115 average throughput is 1.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-20 08:55:33,241 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311205656df981c9d486e95475940d5bc404b to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311205656df981c9d486e95475940d5bc404b 2023-11-20 08:55:33,241 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311207dfa30661655403ab5479e06e8ee819c to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311207dfa30661655403ab5479e06e8ee819c 2023-11-20 08:55:33,242 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231120 table='testCompactionWithHFileLink' column='family1' 2023-11-20 08:55:33,242 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231120 table='testCompactionWithHFileLink' column='family1' 2023-11-20 08:55:33,269 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231120/family1/f1444e366ac24c5d8b8fea3e55bdf407 first=Optional[2\x00\x00\x00\x00] last=Optional[2\x00\x00\x00\x07] 2023-11-20 08:55:33,270 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231120/family1/141c6fdde7e24c21bea5e1b80223700a first=Optional[0\x00\x00\x00\x00] last=Optional[0\x00\x00\x00\x07] 2023-11-20 08:55:33,270 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903., hostname=jenkins-hbase4.apache.org,38491,1700470412215, seqNum=32 for row 2 with hfile group [{family1,hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231120/family1/f1444e366ac24c5d8b8fea3e55bdf407}] 2023-11-20 08:55:33,271 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd., hostname=jenkins-hbase4.apache.org,38491,1700470412215, seqNum=32 for row with hfile group [{family1,hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231120/family1/141c6fdde7e24c21bea5e1b80223700a}] 2023-11-20 08:55:33,274 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HStore(763): Validating hfile at hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231120/family1/141c6fdde7e24c21bea5e1b80223700a for inclusion in 85ad044c09ac7e7f46d086f5a2df28bd/family1 2023-11-20 08:55:33,274 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38491] regionserver.HStore(763): Validating hfile at hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231120/family1/f1444e366ac24c5d8b8fea3e55bdf407 for inclusion in c417fce1816d885109d4ed56f4041903/family1 2023-11-20 08:55:33,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x00 last=0\x00\x00\x00\x07 2023-11-20 08:55:33,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HStore(777): Region bounds: first= last=1 2023-11-20 08:55:33,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38491] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x00 last=2\x00\x00\x00\x07 2023-11-20 08:55:33,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38491] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-20 08:55:33,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HRegion(2446): Flush status journal for 85ad044c09ac7e7f46d086f5a2df28bd: 2023-11-20 08:55:33,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38491] regionserver.HRegion(2446): Flush status journal for c417fce1816d885109d4ed56f4041903: 2023-11-20 08:55:33,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231120/family1/141c6fdde7e24c21bea5e1b80223700a to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testCompactionWithHFileLink__g255qmq2ted4av7260r7b99ago0lbj0cda7u8uh2pa14jqqv4btnhgril77kn98m/family1/141c6fdde7e24c21bea5e1b80223700a 2023-11-20 08:55:33,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38491] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231120/family1/f1444e366ac24c5d8b8fea3e55bdf407 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testCompactionWithHFileLink__fucuv0r16gukmvfmiumvjai94l5i14g3loo9umofa5q2nph0jfgjtkgff6d9424f/family1/f1444e366ac24c5d8b8fea3e55bdf407 2023-11-20 08:55:33,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testCompactionWithHFileLink__g255qmq2ted4av7260r7b99ago0lbj0cda7u8uh2pa14jqqv4btnhgril77kn98m/family1/141c6fdde7e24c21bea5e1b80223700a as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/edf5407f2b4f4518b4725140ebbfd725_SeqId_35_ 2023-11-20 08:55:33,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38491] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testCompactionWithHFileLink__fucuv0r16gukmvfmiumvjai94l5i14g3loo9umofa5q2nph0jfgjtkgff6d9424f/family1/f1444e366ac24c5d8b8fea3e55bdf407 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/15468d6f940c4946a4544660a0705a28_SeqId_34_ 2023-11-20 08:55:33,280 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HStore(849): Loaded HFile hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testCompactionWithHFileLink__g255qmq2ted4av7260r7b99ago0lbj0cda7u8uh2pa14jqqv4btnhgril77kn98m/family1/141c6fdde7e24c21bea5e1b80223700a into 85ad044c09ac7e7f46d086f5a2df28bd/family1 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/edf5407f2b4f4518b4725140ebbfd725_SeqId_35_ - updating store file list. 2023-11-20 08:55:33,280 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38491] regionserver.HStore(849): Loaded HFile hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testCompactionWithHFileLink__fucuv0r16gukmvfmiumvjai94l5i14g3loo9umofa5q2nph0jfgjtkgff6d9424f/family1/f1444e366ac24c5d8b8fea3e55bdf407 into c417fce1816d885109d4ed56f4041903/family1 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/15468d6f940c4946a4544660a0705a28_SeqId_34_ - updating store file list. 2023-11-20 08:55:33,283 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HStore(882): Loaded HFile hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/edf5407f2b4f4518b4725140ebbfd725_SeqId_35_ into 85ad044c09ac7e7f46d086f5a2df28bd/family1 2023-11-20 08:55:33,283 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HStore(855): Successfully loaded hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testCompactionWithHFileLink__g255qmq2ted4av7260r7b99ago0lbj0cda7u8uh2pa14jqqv4btnhgril77kn98m/family1/141c6fdde7e24c21bea5e1b80223700a into 85ad044c09ac7e7f46d086f5a2df28bd/family1 (new location: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/edf5407f2b4f4518b4725140ebbfd725_SeqId_35_) 2023-11-20 08:55:33,283 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38491] regionserver.HStore(882): Loaded HFile hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/15468d6f940c4946a4544660a0705a28_SeqId_34_ into c417fce1816d885109d4ed56f4041903/family1 2023-11-20 08:55:33,283 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38491] regionserver.HStore(855): Successfully loaded hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testCompactionWithHFileLink__fucuv0r16gukmvfmiumvjai94l5i14g3loo9umofa5q2nph0jfgjtkgff6d9424f/family1/f1444e366ac24c5d8b8fea3e55bdf407 into c417fce1816d885109d4ed56f4041903/family1 (new location: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/15468d6f940c4946a4544660a0705a28_SeqId_34_) 2023-11-20 08:55:33,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testCompactionWithHFileLink__g255qmq2ted4av7260r7b99ago0lbj0cda7u8uh2pa14jqqv4btnhgril77kn98m/family1/141c6fdde7e24c21bea5e1b80223700a 2023-11-20 08:55:33,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38491] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testCompactionWithHFileLink__fucuv0r16gukmvfmiumvjai94l5i14g3loo9umofa5q2nph0jfgjtkgff6d9424f/family1/f1444e366ac24c5d8b8fea3e55bdf407 2023-11-20 08:55:33,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38491] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-20 08:55:33,285 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231120 table='testCompactionWithHFileLink' column='family1' 2023-11-20 08:55:33,286 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:55:33,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38491] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-11-20 08:55:33,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38491] regionserver.HStore(1912): c417fce1816d885109d4ed56f4041903/family1 is initiating minor compaction (all files) 2023-11-20 08:55:33,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38491] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@58082db3; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-11-20 08:55:33,287 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023112071cf63e3fb3c40b0b53c32617f3340d7 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023112071cf63e3fb3c40b0b53c32617f3340d7 2023-11-20 08:55:33,289 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023112078d310eea24740eba786d4ea973a0f92 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023112078d310eea24740eba786d4ea973a0f92 2023-11-20 08:55:33,289 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231120 table='testCompactionWithHFileLink' column='family1' 2023-11-20 08:55:33,289 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:55:33,290 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231120b8666ade0d124147b4c3e46c3763ef30 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231120b8666ade0d124147b4c3e46c3763ef30 2023-11-20 08:55:33,291 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231120c38961dec1a24a4fa49ebbccf556edd5 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231120c38961dec1a24a4fa49ebbccf556edd5 2023-11-20 08:55:33,291 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-20 08:55:33,291 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231120' 2023-11-20 08:55:33,291 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202311200b72f04ed9dd4745a7416f9fa3f787a3 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202311200b72f04ed9dd4745a7416f9fa3f787a3 2023-11-20 08:55:33,291 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231120 for table='testCompactionWithHFileLink' and column='family1' 2023-11-20 08:55:33,292 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c2023112043f1cb2484844d628527c6caeae200f2 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c2023112043f1cb2484844d628527c6caeae200f2 2023-11-20 08:55:33,293 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231120c8a666d226eb4104ad21c3355768bd45 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231120c8a666d226eb4104ad21c3355768bd45 2023-11-20 08:55:33,293 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231120f43bf08d68b04c5a9298bb294a99ac9d to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231120f43bf08d68b04c5a9298bb294a99ac9d 2023-11-20 08:55:33,294 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-20 08:55:33,294 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231120' 2023-11-20 08:55:33,294 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231120 for table='testCompactionWithHFileLink' and column='family1' 2023-11-20 08:55:33,294 INFO [Listener at localhost/43513] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-11-20 08:55:33,297 DEBUG [Listener at localhost/43513] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-20 08:55:33,299 DEBUG [Listener at localhost/43513] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-20 08:55:33,302 DEBUG [Listener at localhost/43513] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-20 08:55:33,303 DEBUG [Listener at localhost/43513] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-20 08:55:33,310 DEBUG [Listener at localhost/43513] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-20 08:55:33,311 DEBUG [Listener at localhost/43513] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-20 08:55:33,324 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/.tmp/family1/d6c8ae016d564d3782fb452c03760201 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/d6c8ae016d564d3782fb452c03760201 2023-11-20 08:55:33,328 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 85ad044c09ac7e7f46d086f5a2df28bd/family1 of 85ad044c09ac7e7f46d086f5a2df28bd into d6c8ae016d564d3782fb452c03760201(size=7.6 K), total size for store is 14.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-20 08:55:33,329 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 85ad044c09ac7e7f46d086f5a2df28bd: 2023-11-20 08:55:33,329 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd., storeName=85ad044c09ac7e7f46d086f5a2df28bd/family1, priority=12, startTime=1700470532053; duration=1sec 2023-11-20 08:55:33,329 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-11-20 08:55:33,329 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of c417fce1816d885109d4ed56f4041903/family1 in testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903. 2023-11-20 08:55:33,329 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/testCompactionWithHFileLink=c417fce1816d885109d4ed56f4041903-c7c38f61302543f6ab8b229d5a17e082, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/testCompactionWithHFileLink=c417fce1816d885109d4ed56f4041903-e1f18fc59fb04513b77458a0ca57c34c, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/testCompactionWithHFileLink=c417fce1816d885109d4ed56f4041903-1936fbed6edb4fbf92c2a753036428d6, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/testCompactionWithHFileLink=c417fce1816d885109d4ed56f4041903-1bda7aa2c54340fdb0f8c892a0fc0cc4, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/15468d6f940c4946a4544660a0705a28_SeqId_34_] into tmpdir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/.tmp, totalSize=28.9 K 2023-11-20 08:55:33,330 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c417fce1816d885109d4ed56f4041903-c7c38f61302543f6ab8b229d5a17e082, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700470510335 2023-11-20 08:55:33,330 INFO [Listener at localhost/43513] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=289 (was 239) - Thread LEAK? -, OpenFileDescriptor=786 (was 624) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=115 (was 101) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=15006 (was 14659) - AvailableMemoryMB LEAK? - 2023-11-20 08:55:33,330 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c417fce1816d885109d4ed56f4041903-e1f18fc59fb04513b77458a0ca57c34c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700470512170 2023-11-20 08:55:33,335 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c417fce1816d885109d4ed56f4041903-1936fbed6edb4fbf92c2a753036428d6, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700470513975 2023-11-20 08:55:33,335 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c417fce1816d885109d4ed56f4041903-1bda7aa2c54340fdb0f8c892a0fc0cc4, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700470515775 2023-11-20 08:55:33,336 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting 15468d6f940c4946a4544660a0705a28_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1700470510335 2023-11-20 08:55:33,343 INFO [Listener at localhost/43513] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompaction Thread=289, OpenFileDescriptor=786, MaxFileDescriptor=60000, SystemLoadAverage=115, ProcessCount=168, AvailableMemoryMB=15005 2023-11-20 08:55:33,349 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.HMaster$15(3014): Client=jenkins//172.31.14.131 creating {NAME => 'ns'} 2023-11-20 08:55:33,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=ns 2023-11-20 08:55:33,356 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] throttle.PressureAwareThroughputController(145): c417fce1816d885109d4ed56f4041903#family1#compaction#116 average throughput is 0.39 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-20 08:55:33,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-11-20 08:55:33,362 DEBUG [RS:0;jenkins-hbase4:38491-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/.tmp/family1/ed293d2f453743309f40a7c90360d158 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/ed293d2f453743309f40a7c90360d158 2023-11-20 08:55:33,362 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-11-20 08:55:33,366 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; CreateNamespaceProcedure, namespace=ns in 15 msec 2023-11-20 08:55:33,367 INFO [RS:0;jenkins-hbase4:38491-longCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in 3c896a09e2b9659e521fbfa3f4c3a8b7/family1 of 3c896a09e2b9659e521fbfa3f4c3a8b7 into ed293d2f453743309f40a7c90360d158(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-20 08:55:33,367 DEBUG [RS:0;jenkins-hbase4:38491-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 3c896a09e2b9659e521fbfa3f4c3a8b7: 2023-11-20 08:55:33,367 INFO [RS:0;jenkins-hbase4:38491-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1700470532485; duration=0sec 2023-11-20 08:55:33,367 DEBUG [RS:0;jenkins-hbase4:38491-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-11-20 08:55:33,367 DEBUG [RS:0;jenkins-hbase4:38491-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 5 compacting, 0 eligible, 16 blocking 2023-11-20 08:55:33,367 DEBUG [RS:0;jenkins-hbase4:38491-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-11-20 08:55:33,367 DEBUG [RS:0;jenkins-hbase4:38491-longCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-11-20 08:55:33,367 DEBUG [RS:0;jenkins-hbase4:38491-longCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903. because compaction request was cancelled 2023-11-20 08:55:33,367 DEBUG [RS:0;jenkins-hbase4:38491-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-20 08:55:33,370 DEBUG [RS:0;jenkins-hbase4:38491-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-20 08:55:33,370 DEBUG [RS:0;jenkins-hbase4:38491-longCompactions-0] regionserver.HStore(1912): 3c896a09e2b9659e521fbfa3f4c3a8b7/family2 is initiating minor compaction (all files) 2023-11-20 08:55:33,370 INFO [RS:0;jenkins-hbase4:38491-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 3c896a09e2b9659e521fbfa3f4c3a8b7/family2 in testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7. 2023-11-20 08:55:33,370 INFO [RS:0;jenkins-hbase4:38491-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family2/testCompactionWithHFileLink=3c896a09e2b9659e521fbfa3f4c3a8b7-c58b680b02974ce3a6dfe6eb61247c8a, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family2/testCompactionWithHFileLink=3c896a09e2b9659e521fbfa3f4c3a8b7-f352ce62aae04c87b30585be76110820, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family2/testCompactionWithHFileLink=3c896a09e2b9659e521fbfa3f4c3a8b7-f06094b14986481ea9ae6a16eeb26f98, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family2/testCompactionWithHFileLink=3c896a09e2b9659e521fbfa3f4c3a8b7-b21ad80b056243bb82c80545bb922fa9] into tmpdir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/.tmp, totalSize=20.4 K 2023-11-20 08:55:33,371 DEBUG [RS:0;jenkins-hbase4:38491-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=3c896a09e2b9659e521fbfa3f4c3a8b7-c58b680b02974ce3a6dfe6eb61247c8a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700470510334 2023-11-20 08:55:33,371 DEBUG [RS:0;jenkins-hbase4:38491-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=3c896a09e2b9659e521fbfa3f4c3a8b7-f352ce62aae04c87b30585be76110820, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700470512170 2023-11-20 08:55:33,372 DEBUG [RS:0;jenkins-hbase4:38491-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=3c896a09e2b9659e521fbfa3f4c3a8b7-f06094b14986481ea9ae6a16eeb26f98, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700470513975 2023-11-20 08:55:33,373 DEBUG [RS:0;jenkins-hbase4:38491-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=3c896a09e2b9659e521fbfa3f4c3a8b7-b21ad80b056243bb82c80545bb922fa9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700470515775 2023-11-20 08:55:33,377 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/.tmp/family1/707beff7537b47a3ad2828290910b20e as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/707beff7537b47a3ad2828290910b20e 2023-11-20 08:55:33,381 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in c417fce1816d885109d4ed56f4041903/family1 of c417fce1816d885109d4ed56f4041903 into 707beff7537b47a3ad2828290910b20e(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-20 08:55:33,381 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for c417fce1816d885109d4ed56f4041903: 2023-11-20 08:55:33,381 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1700470533287; duration=0sec 2023-11-20 08:55:33,381 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-11-20 08:55:33,381 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-20 08:55:33,384 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-20 08:55:33,384 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HStore(1912): c417fce1816d885109d4ed56f4041903/family2 is initiating minor compaction (all files) 2023-11-20 08:55:33,384 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of c417fce1816d885109d4ed56f4041903/family2 in testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903. 2023-11-20 08:55:33,384 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family2/testCompactionWithHFileLink=c417fce1816d885109d4ed56f4041903-385ba0396fd141c2869c227cb1738afe, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family2/testCompactionWithHFileLink=c417fce1816d885109d4ed56f4041903-463ef75cff3349cfa57903e3803d583c, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family2/testCompactionWithHFileLink=c417fce1816d885109d4ed56f4041903-70b789bd0e2740bc862576c291870517, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family2/testCompactionWithHFileLink=c417fce1816d885109d4ed56f4041903-a4f7262c26c74982adfa4b452ffa6921] into tmpdir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/.tmp, totalSize=20.4 K 2023-11-20 08:55:33,385 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c417fce1816d885109d4ed56f4041903-385ba0396fd141c2869c227cb1738afe, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700470510335 2023-11-20 08:55:33,385 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c417fce1816d885109d4ed56f4041903-463ef75cff3349cfa57903e3803d583c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700470512170 2023-11-20 08:55:33,386 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c417fce1816d885109d4ed56f4041903-70b789bd0e2740bc862576c291870517, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700470513975 2023-11-20 08:55:33,387 INFO [RS:0;jenkins-hbase4:38491-longCompactions-0] throttle.PressureAwareThroughputController(145): 3c896a09e2b9659e521fbfa3f4c3a8b7#family2#compaction#117 average throughput is 0.39 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-20 08:55:33,387 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c417fce1816d885109d4ed56f4041903-a4f7262c26c74982adfa4b452ffa6921, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700470515775 2023-11-20 08:55:33,400 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] throttle.PressureAwareThroughputController(145): c417fce1816d885109d4ed56f4041903#family2#compaction#118 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-20 08:55:33,401 DEBUG [RS:0;jenkins-hbase4:38491-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/.tmp/family2/540eef7216f84c819ea9674a93bd065e as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family2/540eef7216f84c819ea9674a93bd065e 2023-11-20 08:55:33,405 INFO [RS:0;jenkins-hbase4:38491-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 3c896a09e2b9659e521fbfa3f4c3a8b7/family2 of 3c896a09e2b9659e521fbfa3f4c3a8b7 into 540eef7216f84c819ea9674a93bd065e(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-20 08:55:33,405 DEBUG [RS:0;jenkins-hbase4:38491-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 3c896a09e2b9659e521fbfa3f4c3a8b7: 2023-11-20 08:55:33,405 INFO [RS:0;jenkins-hbase4:38491-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7., storeName=3c896a09e2b9659e521fbfa3f4c3a8b7/family2, priority=12, startTime=1700470532190; duration=0sec 2023-11-20 08:55:33,406 DEBUG [RS:0;jenkins-hbase4:38491-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-11-20 08:55:33,406 DEBUG [RS:0;jenkins-hbase4:38491-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-11-20 08:55:33,406 DEBUG [RS:0;jenkins-hbase4:38491-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-11-20 08:55:33,406 DEBUG [RS:0;jenkins-hbase4:38491-longCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-11-20 08:55:33,406 DEBUG [RS:0;jenkins-hbase4:38491-longCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7. because compaction request was cancelled 2023-11-20 08:55:33,426 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/testCompactionWithHFileLink=85ad044c09ac7e7f46d086f5a2df28bd-2bc034df4b214a4f85aa27534763b0da, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/testCompactionWithHFileLink=85ad044c09ac7e7f46d086f5a2df28bd-ec23d5df0abb4729ad90a33a90eb66c5, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/testCompactionWithHFileLink=85ad044c09ac7e7f46d086f5a2df28bd-2a3fabf5d99147039126dbb098f308b8, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/testCompactionWithHFileLink=85ad044c09ac7e7f46d086f5a2df28bd-b350610b1eb2407d9ed82182edee91dc] to archive 2023-11-20 08:55:33,426 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:55:33,428 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/testCompactionWithHFileLink=85ad044c09ac7e7f46d086f5a2df28bd-2bc034df4b214a4f85aa27534763b0da to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/testCompactionWithHFileLink=85ad044c09ac7e7f46d086f5a2df28bd-2bc034df4b214a4f85aa27534763b0da 2023-11-20 08:55:33,429 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/testCompactionWithHFileLink=85ad044c09ac7e7f46d086f5a2df28bd-ec23d5df0abb4729ad90a33a90eb66c5 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/testCompactionWithHFileLink=85ad044c09ac7e7f46d086f5a2df28bd-ec23d5df0abb4729ad90a33a90eb66c5 2023-11-20 08:55:33,429 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/testCompactionWithHFileLink=85ad044c09ac7e7f46d086f5a2df28bd-2a3fabf5d99147039126dbb098f308b8 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/testCompactionWithHFileLink=85ad044c09ac7e7f46d086f5a2df28bd-2a3fabf5d99147039126dbb098f308b8 2023-11-20 08:55:33,430 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/testCompactionWithHFileLink=85ad044c09ac7e7f46d086f5a2df28bd-b350610b1eb2407d9ed82182edee91dc to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/family1/testCompactionWithHFileLink=85ad044c09ac7e7f46d086f5a2df28bd-b350610b1eb2407d9ed82182edee91dc 2023-11-20 08:55:33,432 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/testCompactionWithHFileLink=c417fce1816d885109d4ed56f4041903-c7c38f61302543f6ab8b229d5a17e082, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/testCompactionWithHFileLink=c417fce1816d885109d4ed56f4041903-e1f18fc59fb04513b77458a0ca57c34c, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/testCompactionWithHFileLink=c417fce1816d885109d4ed56f4041903-1936fbed6edb4fbf92c2a753036428d6, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/testCompactionWithHFileLink=c417fce1816d885109d4ed56f4041903-1bda7aa2c54340fdb0f8c892a0fc0cc4, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/15468d6f940c4946a4544660a0705a28_SeqId_34_] to archive 2023-11-20 08:55:33,432 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:55:33,433 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/testCompactionWithHFileLink=c417fce1816d885109d4ed56f4041903-c7c38f61302543f6ab8b229d5a17e082 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/testCompactionWithHFileLink=c417fce1816d885109d4ed56f4041903-c7c38f61302543f6ab8b229d5a17e082 2023-11-20 08:55:33,434 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/testCompactionWithHFileLink=c417fce1816d885109d4ed56f4041903-e1f18fc59fb04513b77458a0ca57c34c to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/testCompactionWithHFileLink=c417fce1816d885109d4ed56f4041903-e1f18fc59fb04513b77458a0ca57c34c 2023-11-20 08:55:33,435 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/testCompactionWithHFileLink=c417fce1816d885109d4ed56f4041903-1936fbed6edb4fbf92c2a753036428d6 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/testCompactionWithHFileLink=c417fce1816d885109d4ed56f4041903-1936fbed6edb4fbf92c2a753036428d6 2023-11-20 08:55:33,436 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/testCompactionWithHFileLink=c417fce1816d885109d4ed56f4041903-1bda7aa2c54340fdb0f8c892a0fc0cc4 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/testCompactionWithHFileLink=c417fce1816d885109d4ed56f4041903-1bda7aa2c54340fdb0f8c892a0fc0cc4 2023-11-20 08:55:33,437 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/15468d6f940c4946a4544660a0705a28_SeqId_34_ to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family1/15468d6f940c4946a4544660a0705a28_SeqId_34_ 2023-11-20 08:55:33,438 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/testCompactionWithHFileLink=3c896a09e2b9659e521fbfa3f4c3a8b7-fa4d45a0dc0d44169e48cf27b5b4a06c, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/testCompactionWithHFileLink=3c896a09e2b9659e521fbfa3f4c3a8b7-1e83151507e6498591a9f13142d5a99a, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/testCompactionWithHFileLink=3c896a09e2b9659e521fbfa3f4c3a8b7-cf739c3495224991832bce73e7fff537, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/testCompactionWithHFileLink=3c896a09e2b9659e521fbfa3f4c3a8b7-baa9f3cddff746cda812640b187caf04, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/04fa25d3ea24485394969684374d7194_SeqId_34_] to archive 2023-11-20 08:55:33,439 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:55:33,440 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/testCompactionWithHFileLink=3c896a09e2b9659e521fbfa3f4c3a8b7-fa4d45a0dc0d44169e48cf27b5b4a06c to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/testCompactionWithHFileLink=3c896a09e2b9659e521fbfa3f4c3a8b7-fa4d45a0dc0d44169e48cf27b5b4a06c 2023-11-20 08:55:33,441 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/testCompactionWithHFileLink=3c896a09e2b9659e521fbfa3f4c3a8b7-1e83151507e6498591a9f13142d5a99a to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/testCompactionWithHFileLink=3c896a09e2b9659e521fbfa3f4c3a8b7-1e83151507e6498591a9f13142d5a99a 2023-11-20 08:55:33,442 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/testCompactionWithHFileLink=3c896a09e2b9659e521fbfa3f4c3a8b7-cf739c3495224991832bce73e7fff537 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/testCompactionWithHFileLink=3c896a09e2b9659e521fbfa3f4c3a8b7-cf739c3495224991832bce73e7fff537 2023-11-20 08:55:33,443 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/testCompactionWithHFileLink=3c896a09e2b9659e521fbfa3f4c3a8b7-baa9f3cddff746cda812640b187caf04 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/testCompactionWithHFileLink=3c896a09e2b9659e521fbfa3f4c3a8b7-baa9f3cddff746cda812640b187caf04 2023-11-20 08:55:33,444 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/04fa25d3ea24485394969684374d7194_SeqId_34_ to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family1/04fa25d3ea24485394969684374d7194_SeqId_34_ 2023-11-20 08:55:33,445 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family2/testCompactionWithHFileLink=3c896a09e2b9659e521fbfa3f4c3a8b7-c58b680b02974ce3a6dfe6eb61247c8a, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family2/testCompactionWithHFileLink=3c896a09e2b9659e521fbfa3f4c3a8b7-f352ce62aae04c87b30585be76110820, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family2/testCompactionWithHFileLink=3c896a09e2b9659e521fbfa3f4c3a8b7-f06094b14986481ea9ae6a16eeb26f98, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family2/testCompactionWithHFileLink=3c896a09e2b9659e521fbfa3f4c3a8b7-b21ad80b056243bb82c80545bb922fa9] to archive 2023-11-20 08:55:33,445 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:55:33,446 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family2/testCompactionWithHFileLink=3c896a09e2b9659e521fbfa3f4c3a8b7-c58b680b02974ce3a6dfe6eb61247c8a to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family2/testCompactionWithHFileLink=3c896a09e2b9659e521fbfa3f4c3a8b7-c58b680b02974ce3a6dfe6eb61247c8a 2023-11-20 08:55:33,447 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family2/testCompactionWithHFileLink=3c896a09e2b9659e521fbfa3f4c3a8b7-f352ce62aae04c87b30585be76110820 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family2/testCompactionWithHFileLink=3c896a09e2b9659e521fbfa3f4c3a8b7-f352ce62aae04c87b30585be76110820 2023-11-20 08:55:33,448 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family2/testCompactionWithHFileLink=3c896a09e2b9659e521fbfa3f4c3a8b7-f06094b14986481ea9ae6a16eeb26f98 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family2/testCompactionWithHFileLink=3c896a09e2b9659e521fbfa3f4c3a8b7-f06094b14986481ea9ae6a16eeb26f98 2023-11-20 08:55:33,449 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family2/testCompactionWithHFileLink=3c896a09e2b9659e521fbfa3f4c3a8b7-b21ad80b056243bb82c80545bb922fa9 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/family2/testCompactionWithHFileLink=3c896a09e2b9659e521fbfa3f4c3a8b7-b21ad80b056243bb82c80545bb922fa9 2023-11-20 08:55:33,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-11-20 08:55:33,458 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-20 08:55:33,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=ns:testMinorCompaction 2023-11-20 08:55:33,460 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-11-20 08:55:33,461 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "ns" qualifier: "testMinorCompaction" procId is: 105 2023-11-20 08:55:33,461 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-20 08:55:33,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-20 08:55:33,463 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803 2023-11-20 08:55:33,463 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef 2023-11-20 08:55:33,463 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce 2023-11-20 08:55:33,463 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803 empty. 2023-11-20 08:55:33,463 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef empty. 2023-11-20 08:55:33,463 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce empty. 2023-11-20 08:55:33,464 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803 2023-11-20 08:55:33,464 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce 2023-11-20 08:55:33,464 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef 2023-11-20 08:55:33,464 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived ns:testMinorCompaction regions 2023-11-20 08:55:33,497 DEBUG [regionserver/jenkins-hbase4:0.Chore.2] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.07692307692307693, tune throughput to 53.85 MB/second 2023-11-20 08:55:33,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-20 08:55:33,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-20 08:55:33,870 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/ns/testMinorCompaction/.tabledesc/.tableinfo.0000000001 2023-11-20 08:55:33,872 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(7675): creating {ENCODED => a4223368d0abcd3a665a863e674f7fce, NAME => 'ns:testMinorCompaction,2,1700470533458.a4223368d0abcd3a665a863e674f7fce.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp 2023-11-20 08:55:33,872 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => 37ddd3693eda6c49fa96f6147c47a803, NAME => 'ns:testMinorCompaction,,1700470533458.37ddd3693eda6c49fa96f6147c47a803.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp 2023-11-20 08:55:33,872 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(7675): creating {ENCODED => 7d61965cf9967510cc3eaf24947bb0ef, NAME => 'ns:testMinorCompaction,1,1700470533458.7d61965cf9967510cc3eaf24947bb0ef.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp 2023-11-20 08:55:34,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-20 08:55:34,278 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1700470533458.a4223368d0abcd3a665a863e674f7fce.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-20 08:55:34,278 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1604): Closing a4223368d0abcd3a665a863e674f7fce, disabling compactions & flushes 2023-11-20 08:55:34,278 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1700470533458.a4223368d0abcd3a665a863e674f7fce. 2023-11-20 08:55:34,278 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1700470533458.a4223368d0abcd3a665a863e674f7fce. 2023-11-20 08:55:34,278 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1700470533458.7d61965cf9967510cc3eaf24947bb0ef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-20 08:55:34,278 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1700470533458.a4223368d0abcd3a665a863e674f7fce. after waiting 0 ms 2023-11-20 08:55:34,278 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1604): Closing 7d61965cf9967510cc3eaf24947bb0ef, disabling compactions & flushes 2023-11-20 08:55:34,278 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1700470533458.a4223368d0abcd3a665a863e674f7fce. 2023-11-20 08:55:34,278 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1700470533458.7d61965cf9967510cc3eaf24947bb0ef. 2023-11-20 08:55:34,278 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1700470533458.7d61965cf9967510cc3eaf24947bb0ef. 2023-11-20 08:55:34,278 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1700470533458.7d61965cf9967510cc3eaf24947bb0ef. after waiting 0 ms 2023-11-20 08:55:34,278 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1700470533458.7d61965cf9967510cc3eaf24947bb0ef. 2023-11-20 08:55:34,278 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1700470533458.a4223368d0abcd3a665a863e674f7fce. 2023-11-20 08:55:34,278 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1700470533458.7d61965cf9967510cc3eaf24947bb0ef. 2023-11-20 08:55:34,278 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1558): Region close journal for 7d61965cf9967510cc3eaf24947bb0ef: 2023-11-20 08:55:34,278 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1558): Region close journal for a4223368d0abcd3a665a863e674f7fce: 2023-11-20 08:55:34,279 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-20 08:55:34,282 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1700470533458.37ddd3693eda6c49fa96f6147c47a803.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-20 08:55:34,282 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1604): Closing 37ddd3693eda6c49fa96f6147c47a803, disabling compactions & flushes 2023-11-20 08:55:34,282 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1700470533458.37ddd3693eda6c49fa96f6147c47a803. 2023-11-20 08:55:34,282 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1700470533458.37ddd3693eda6c49fa96f6147c47a803. 2023-11-20 08:55:34,282 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1700470533458.37ddd3693eda6c49fa96f6147c47a803. after waiting 0 ms 2023-11-20 08:55:34,282 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1700470533458.37ddd3693eda6c49fa96f6147c47a803. 2023-11-20 08:55:34,283 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1700470533458.37ddd3693eda6c49fa96f6147c47a803. 2023-11-20 08:55:34,283 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1558): Region close journal for 37ddd3693eda6c49fa96f6147c47a803: 2023-11-20 08:55:34,285 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-11-20 08:55:34,286 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,1,1700470533458.7d61965cf9967510cc3eaf24947bb0ef.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1700470534286"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700470534286"}]},"ts":"1700470534286"} 2023-11-20 08:55:34,286 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,2,1700470533458.a4223368d0abcd3a665a863e674f7fce.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1700470534286"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700470534286"}]},"ts":"1700470534286"} 2023-11-20 08:55:34,286 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,,1700470533458.37ddd3693eda6c49fa96f6147c47a803.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1700470534286"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700470534286"}]},"ts":"1700470534286"} 2023-11-20 08:55:34,287 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-20 08:55:34,288 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-20 08:55:34,288 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700470534288"}]},"ts":"1700470534288"} 2023-11-20 08:55:34,289 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLING in hbase:meta 2023-11-20 08:55:34,300 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=37ddd3693eda6c49fa96f6147c47a803, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=7d61965cf9967510cc3eaf24947bb0ef, ASSIGN}, {pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=a4223368d0abcd3a665a863e674f7fce, ASSIGN}] 2023-11-20 08:55:34,302 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=a4223368d0abcd3a665a863e674f7fce, ASSIGN 2023-11-20 08:55:34,302 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=7d61965cf9967510cc3eaf24947bb0ef, ASSIGN 2023-11-20 08:55:34,302 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=37ddd3693eda6c49fa96f6147c47a803, ASSIGN 2023-11-20 08:55:34,302 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=a4223368d0abcd3a665a863e674f7fce, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38491,1700470412215; forceNewPlan=false, retain=false 2023-11-20 08:55:34,302 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=7d61965cf9967510cc3eaf24947bb0ef, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38491,1700470412215; forceNewPlan=false, retain=false 2023-11-20 08:55:34,302 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=37ddd3693eda6c49fa96f6147c47a803, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38491,1700470412215; forceNewPlan=false, retain=false 2023-11-20 08:55:34,455 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=7d61965cf9967510cc3eaf24947bb0ef, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:34,455 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=37ddd3693eda6c49fa96f6147c47a803, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:34,455 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=a4223368d0abcd3a665a863e674f7fce, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:34,455 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,1,1700470533458.7d61965cf9967510cc3eaf24947bb0ef.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1700470534455"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700470534455"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700470534455"}]},"ts":"1700470534455"} 2023-11-20 08:55:34,455 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,2,1700470533458.a4223368d0abcd3a665a863e674f7fce.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1700470534455"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700470534455"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700470534455"}]},"ts":"1700470534455"} 2023-11-20 08:55:34,455 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,,1700470533458.37ddd3693eda6c49fa96f6147c47a803.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1700470534455"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700470534455"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700470534455"}]},"ts":"1700470534455"} 2023-11-20 08:55:34,456 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 7d61965cf9967510cc3eaf24947bb0ef, server=jenkins-hbase4.apache.org,38491,1700470412215}] 2023-11-20 08:55:34,457 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=110, ppid=108, state=RUNNABLE; OpenRegionProcedure a4223368d0abcd3a665a863e674f7fce, server=jenkins-hbase4.apache.org,38491,1700470412215}] 2023-11-20 08:55:34,457 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=111, ppid=106, state=RUNNABLE; OpenRegionProcedure 37ddd3693eda6c49fa96f6147c47a803, server=jenkins-hbase4.apache.org,38491,1700470412215}] 2023-11-20 08:55:34,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-20 08:55:34,608 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:34,611 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,2,1700470533458.a4223368d0abcd3a665a863e674f7fce. 2023-11-20 08:55:34,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a4223368d0abcd3a665a863e674f7fce, NAME => 'ns:testMinorCompaction,2,1700470533458.a4223368d0abcd3a665a863e674f7fce.', STARTKEY => '2', ENDKEY => ''} 2023-11-20 08:55:34,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction a4223368d0abcd3a665a863e674f7fce 2023-11-20 08:55:34,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1700470533458.a4223368d0abcd3a665a863e674f7fce.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-20 08:55:34,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a4223368d0abcd3a665a863e674f7fce 2023-11-20 08:55:34,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a4223368d0abcd3a665a863e674f7fce 2023-11-20 08:55:34,612 INFO [StoreOpener-a4223368d0abcd3a665a863e674f7fce-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region a4223368d0abcd3a665a863e674f7fce 2023-11-20 08:55:34,614 DEBUG [StoreOpener-a4223368d0abcd3a665a863e674f7fce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/family1 2023-11-20 08:55:34,614 DEBUG [StoreOpener-a4223368d0abcd3a665a863e674f7fce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/family1 2023-11-20 08:55:34,614 INFO [StoreOpener-a4223368d0abcd3a665a863e674f7fce-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a4223368d0abcd3a665a863e674f7fce columnFamilyName family1 2023-11-20 08:55:34,615 INFO [StoreOpener-a4223368d0abcd3a665a863e674f7fce-1] regionserver.HStore(310): Store=a4223368d0abcd3a665a863e674f7fce/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-20 08:55:34,615 INFO [StoreOpener-a4223368d0abcd3a665a863e674f7fce-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region a4223368d0abcd3a665a863e674f7fce 2023-11-20 08:55:34,617 DEBUG [StoreOpener-a4223368d0abcd3a665a863e674f7fce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/family2 2023-11-20 08:55:34,617 DEBUG [StoreOpener-a4223368d0abcd3a665a863e674f7fce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/family2 2023-11-20 08:55:34,617 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/.tmp/family2/4dc1051e45d648c7b3d6335686678965 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family2/4dc1051e45d648c7b3d6335686678965 2023-11-20 08:55:34,617 INFO [StoreOpener-a4223368d0abcd3a665a863e674f7fce-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a4223368d0abcd3a665a863e674f7fce columnFamilyName family2 2023-11-20 08:55:34,618 INFO [StoreOpener-a4223368d0abcd3a665a863e674f7fce-1] regionserver.HStore(310): Store=a4223368d0abcd3a665a863e674f7fce/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-20 08:55:34,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce 2023-11-20 08:55:34,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce 2023-11-20 08:55:34,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-20 08:55:34,621 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in c417fce1816d885109d4ed56f4041903/family2 of c417fce1816d885109d4ed56f4041903 into 4dc1051e45d648c7b3d6335686678965(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-20 08:55:34,621 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for c417fce1816d885109d4ed56f4041903: 2023-11-20 08:55:34,621 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903., storeName=c417fce1816d885109d4ed56f4041903/family2, priority=12, startTime=1700470532130; duration=1sec 2023-11-20 08:55:34,621 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-20 08:55:34,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a4223368d0abcd3a665a863e674f7fce 2023-11-20 08:55:34,623 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-20 08:55:34,623 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a4223368d0abcd3a665a863e674f7fce; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61008955, jitterRate=-0.09089572727680206}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-20 08:55:34,623 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a4223368d0abcd3a665a863e674f7fce: 2023-11-20 08:55:34,624 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,2,1700470533458.a4223368d0abcd3a665a863e674f7fce., pid=110, masterSystemTime=1700470534608 2023-11-20 08:55:34,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,2,1700470533458.a4223368d0abcd3a665a863e674f7fce. 2023-11-20 08:55:34,625 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,2,1700470533458.a4223368d0abcd3a665a863e674f7fce. 2023-11-20 08:55:34,625 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,,1700470533458.37ddd3693eda6c49fa96f6147c47a803. 2023-11-20 08:55:34,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 37ddd3693eda6c49fa96f6147c47a803, NAME => 'ns:testMinorCompaction,,1700470533458.37ddd3693eda6c49fa96f6147c47a803.', STARTKEY => '', ENDKEY => '1'} 2023-11-20 08:55:34,626 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=a4223368d0abcd3a665a863e674f7fce, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:34,626 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,2,1700470533458.a4223368d0abcd3a665a863e674f7fce.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1700470534625"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700470534625"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700470534625"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700470534625"}]},"ts":"1700470534625"} 2023-11-20 08:55:34,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 37ddd3693eda6c49fa96f6147c47a803 2023-11-20 08:55:34,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1700470533458.37ddd3693eda6c49fa96f6147c47a803.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-20 08:55:34,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 37ddd3693eda6c49fa96f6147c47a803 2023-11-20 08:55:34,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 37ddd3693eda6c49fa96f6147c47a803 2023-11-20 08:55:34,627 INFO [StoreOpener-37ddd3693eda6c49fa96f6147c47a803-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 37ddd3693eda6c49fa96f6147c47a803 2023-11-20 08:55:34,628 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=110, resume processing ppid=108 2023-11-20 08:55:34,628 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=110, ppid=108, state=SUCCESS; OpenRegionProcedure a4223368d0abcd3a665a863e674f7fce, server=jenkins-hbase4.apache.org,38491,1700470412215 in 170 msec 2023-11-20 08:55:34,628 DEBUG [StoreOpener-37ddd3693eda6c49fa96f6147c47a803-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/family1 2023-11-20 08:55:34,628 DEBUG [StoreOpener-37ddd3693eda6c49fa96f6147c47a803-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/family1 2023-11-20 08:55:34,629 INFO [StoreOpener-37ddd3693eda6c49fa96f6147c47a803-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 37ddd3693eda6c49fa96f6147c47a803 columnFamilyName family1 2023-11-20 08:55:34,629 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=a4223368d0abcd3a665a863e674f7fce, ASSIGN in 328 msec 2023-11-20 08:55:34,629 INFO [StoreOpener-37ddd3693eda6c49fa96f6147c47a803-1] regionserver.HStore(310): Store=37ddd3693eda6c49fa96f6147c47a803/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-20 08:55:34,630 INFO [StoreOpener-37ddd3693eda6c49fa96f6147c47a803-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 37ddd3693eda6c49fa96f6147c47a803 2023-11-20 08:55:34,630 DEBUG [StoreOpener-37ddd3693eda6c49fa96f6147c47a803-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/family2 2023-11-20 08:55:34,631 DEBUG [StoreOpener-37ddd3693eda6c49fa96f6147c47a803-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/family2 2023-11-20 08:55:34,631 INFO [StoreOpener-37ddd3693eda6c49fa96f6147c47a803-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 37ddd3693eda6c49fa96f6147c47a803 columnFamilyName family2 2023-11-20 08:55:34,632 INFO [StoreOpener-37ddd3693eda6c49fa96f6147c47a803-1] regionserver.HStore(310): Store=37ddd3693eda6c49fa96f6147c47a803/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-20 08:55:34,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803 2023-11-20 08:55:34,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803 2023-11-20 08:55:34,634 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family2/testCompactionWithHFileLink=c417fce1816d885109d4ed56f4041903-385ba0396fd141c2869c227cb1738afe, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family2/testCompactionWithHFileLink=c417fce1816d885109d4ed56f4041903-463ef75cff3349cfa57903e3803d583c, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family2/testCompactionWithHFileLink=c417fce1816d885109d4ed56f4041903-70b789bd0e2740bc862576c291870517, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family2/testCompactionWithHFileLink=c417fce1816d885109d4ed56f4041903-a4f7262c26c74982adfa4b452ffa6921] to archive 2023-11-20 08:55:34,634 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-20 08:55:34,634 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:55:34,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 37ddd3693eda6c49fa96f6147c47a803 2023-11-20 08:55:34,636 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family2/testCompactionWithHFileLink=c417fce1816d885109d4ed56f4041903-385ba0396fd141c2869c227cb1738afe to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family2/testCompactionWithHFileLink=c417fce1816d885109d4ed56f4041903-385ba0396fd141c2869c227cb1738afe 2023-11-20 08:55:34,637 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family2/testCompactionWithHFileLink=c417fce1816d885109d4ed56f4041903-463ef75cff3349cfa57903e3803d583c to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family2/testCompactionWithHFileLink=c417fce1816d885109d4ed56f4041903-463ef75cff3349cfa57903e3803d583c 2023-11-20 08:55:34,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-20 08:55:34,638 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 37ddd3693eda6c49fa96f6147c47a803; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75042022, jitterRate=0.11821326613426208}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-20 08:55:34,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 37ddd3693eda6c49fa96f6147c47a803: 2023-11-20 08:55:34,638 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family2/testCompactionWithHFileLink=c417fce1816d885109d4ed56f4041903-70b789bd0e2740bc862576c291870517 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family2/testCompactionWithHFileLink=c417fce1816d885109d4ed56f4041903-70b789bd0e2740bc862576c291870517 2023-11-20 08:55:34,639 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,,1700470533458.37ddd3693eda6c49fa96f6147c47a803., pid=111, masterSystemTime=1700470534608 2023-11-20 08:55:34,640 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family2/testCompactionWithHFileLink=c417fce1816d885109d4ed56f4041903-a4f7262c26c74982adfa4b452ffa6921 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/family2/testCompactionWithHFileLink=c417fce1816d885109d4ed56f4041903-a4f7262c26c74982adfa4b452ffa6921 2023-11-20 08:55:34,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,,1700470533458.37ddd3693eda6c49fa96f6147c47a803. 2023-11-20 08:55:34,640 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,,1700470533458.37ddd3693eda6c49fa96f6147c47a803. 2023-11-20 08:55:34,640 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,1,1700470533458.7d61965cf9967510cc3eaf24947bb0ef. 2023-11-20 08:55:34,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7d61965cf9967510cc3eaf24947bb0ef, NAME => 'ns:testMinorCompaction,1,1700470533458.7d61965cf9967510cc3eaf24947bb0ef.', STARTKEY => '1', ENDKEY => '2'} 2023-11-20 08:55:34,640 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=37ddd3693eda6c49fa96f6147c47a803, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:34,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 7d61965cf9967510cc3eaf24947bb0ef 2023-11-20 08:55:34,640 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,,1700470533458.37ddd3693eda6c49fa96f6147c47a803.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1700470534640"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700470534640"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700470534640"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700470534640"}]},"ts":"1700470534640"} 2023-11-20 08:55:34,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1700470533458.7d61965cf9967510cc3eaf24947bb0ef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-20 08:55:34,641 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7d61965cf9967510cc3eaf24947bb0ef 2023-11-20 08:55:34,641 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7d61965cf9967510cc3eaf24947bb0ef 2023-11-20 08:55:34,641 INFO [StoreOpener-7d61965cf9967510cc3eaf24947bb0ef-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 7d61965cf9967510cc3eaf24947bb0ef 2023-11-20 08:55:34,643 DEBUG [StoreOpener-7d61965cf9967510cc3eaf24947bb0ef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/family1 2023-11-20 08:55:34,643 DEBUG [StoreOpener-7d61965cf9967510cc3eaf24947bb0ef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/family1 2023-11-20 08:55:34,643 INFO [StoreOpener-7d61965cf9967510cc3eaf24947bb0ef-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7d61965cf9967510cc3eaf24947bb0ef columnFamilyName family1 2023-11-20 08:55:34,643 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=111, resume processing ppid=106 2023-11-20 08:55:34,643 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=111, ppid=106, state=SUCCESS; OpenRegionProcedure 37ddd3693eda6c49fa96f6147c47a803, server=jenkins-hbase4.apache.org,38491,1700470412215 in 185 msec 2023-11-20 08:55:34,644 INFO [StoreOpener-7d61965cf9967510cc3eaf24947bb0ef-1] regionserver.HStore(310): Store=7d61965cf9967510cc3eaf24947bb0ef/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-20 08:55:34,644 INFO [StoreOpener-7d61965cf9967510cc3eaf24947bb0ef-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 7d61965cf9967510cc3eaf24947bb0ef 2023-11-20 08:55:34,644 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=37ddd3693eda6c49fa96f6147c47a803, ASSIGN in 343 msec 2023-11-20 08:55:34,645 DEBUG [StoreOpener-7d61965cf9967510cc3eaf24947bb0ef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/family2 2023-11-20 08:55:34,645 DEBUG [StoreOpener-7d61965cf9967510cc3eaf24947bb0ef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/family2 2023-11-20 08:55:34,646 INFO [StoreOpener-7d61965cf9967510cc3eaf24947bb0ef-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7d61965cf9967510cc3eaf24947bb0ef columnFamilyName family2 2023-11-20 08:55:34,646 INFO [StoreOpener-7d61965cf9967510cc3eaf24947bb0ef-1] regionserver.HStore(310): Store=7d61965cf9967510cc3eaf24947bb0ef/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-20 08:55:34,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef 2023-11-20 08:55:34,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef 2023-11-20 08:55:34,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-20 08:55:34,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7d61965cf9967510cc3eaf24947bb0ef 2023-11-20 08:55:34,651 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-20 08:55:34,652 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7d61965cf9967510cc3eaf24947bb0ef; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66220982, jitterRate=-0.013230472803115845}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-20 08:55:34,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7d61965cf9967510cc3eaf24947bb0ef: 2023-11-20 08:55:34,652 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,1,1700470533458.7d61965cf9967510cc3eaf24947bb0ef., pid=109, masterSystemTime=1700470534608 2023-11-20 08:55:34,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,1,1700470533458.7d61965cf9967510cc3eaf24947bb0ef. 2023-11-20 08:55:34,653 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,1,1700470533458.7d61965cf9967510cc3eaf24947bb0ef. 2023-11-20 08:55:34,653 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=7d61965cf9967510cc3eaf24947bb0ef, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:34,654 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,1,1700470533458.7d61965cf9967510cc3eaf24947bb0ef.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1700470534653"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700470534653"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700470534653"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700470534653"}]},"ts":"1700470534653"} 2023-11-20 08:55:34,656 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=107 2023-11-20 08:55:34,656 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 7d61965cf9967510cc3eaf24947bb0ef, server=jenkins-hbase4.apache.org,38491,1700470412215 in 199 msec 2023-11-20 08:55:34,657 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=107, resume processing ppid=105 2023-11-20 08:55:34,657 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=7d61965cf9967510cc3eaf24947bb0ef, ASSIGN in 356 msec 2023-11-20 08:55:34,658 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-20 08:55:34,658 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700470534658"}]},"ts":"1700470534658"} 2023-11-20 08:55:34,659 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLED in hbase:meta 2023-11-20 08:55:34,661 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-11-20 08:55:34,662 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=ns:testMinorCompaction in 1.2030 sec 2023-11-20 08:55:35,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-20 08:55:35,566 INFO [Listener at localhost/43513] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: ns:testMinorCompaction, procId: 105 completed 2023-11-20 08:55:35,572 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38491] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1700470533458.37ddd3693eda6c49fa96f6147c47a803. with WAL disabled. Data may be lost in the event of a crash. 2023-11-20 08:55:35,572 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38491] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1700470533458.7d61965cf9967510cc3eaf24947bb0ef. with WAL disabled. Data may be lost in the event of a crash. 2023-11-20 08:55:35,572 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38491] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1700470533458.a4223368d0abcd3a665a863e674f7fce. with WAL disabled. Data may be lost in the event of a crash. 2023-11-20 08:55:35,574 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:55:35,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-20 08:55:35,576 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-20 08:55:35,576 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:55:35,576 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-20 08:55:35,576 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-20 08:55:35,576 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-20 08:55:35,577 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-20 08:55:35,578 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:55:35,578 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:35,578 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:55:35,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:55:35,578 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:35,578 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:55:35,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-20 08:55:35,579 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-20 08:55:35,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:55:35,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-20 08:55:35,579 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-20 08:55:35,579 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-20 08:55:35,579 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-20 08:55:35,579 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:55:35,579 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-20 08:55:35,580 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1700470533458.7d61965cf9967510cc3eaf24947bb0ef. 2023-11-20 08:55:35,580 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1700470533458.7d61965cf9967510cc3eaf24947bb0ef. started... 2023-11-20 08:55:35,580 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-20 08:55:35,581 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:55:35,582 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7d61965cf9967510cc3eaf24947bb0ef 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-20 08:55:35,582 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1700470533458.a4223368d0abcd3a665a863e674f7fce. 2023-11-20 08:55:35,582 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1700470533458.a4223368d0abcd3a665a863e674f7fce. started... 2023-11-20 08:55:35,580 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1700470533458.37ddd3693eda6c49fa96f6147c47a803. 2023-11-20 08:55:35,582 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing a4223368d0abcd3a665a863e674f7fce 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-20 08:55:35,582 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1700470533458.37ddd3693eda6c49fa96f6147c47a803. started... 2023-11-20 08:55:35,582 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 37ddd3693eda6c49fa96f6147c47a803 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-20 08:55:35,995 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311207d06e1baf2e34d009074ed2e8abf6026 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202311207d06e1baf2e34d009074ed2e8abf6026 2023-11-20 08:55:35,995 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023112039faf3037ad14b9996864085d5013919 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023112039faf3037ad14b9996864085d5013919 2023-11-20 08:55:35,995 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023112079043a0aedeb4c12afb97d4dd362c16e to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023112079043a0aedeb4c12afb97d4dd362c16e 2023-11-20 08:55:36,404 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/.tmp/family1/d50ee8413982412599cbdd6b17520fd4 2023-11-20 08:55:36,404 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/.tmp/family1/3366b2be2edd432c8217b46a323fc446 2023-11-20 08:55:36,404 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/.tmp/family1/b004f06d04c74bc0a98c5139477f3320 2023-11-20 08:55:36,418 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023112062a1fe557eca4a36981614bd4085b8ac to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b2023112062a1fe557eca4a36981614bd4085b8ac 2023-11-20 08:55:36,422 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/.tmp/family2/c3e606e20b044e63b397fcdfc41fe050 2023-11-20 08:55:36,425 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/.tmp/family1/b004f06d04c74bc0a98c5139477f3320 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/family1/b004f06d04c74bc0a98c5139477f3320 2023-11-20 08:55:36,428 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/family1/b004f06d04c74bc0a98c5139477f3320, entries=4, sequenceid=5, filesize=5.4 K 2023-11-20 08:55:36,428 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/.tmp/family2/c3e606e20b044e63b397fcdfc41fe050 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/family2/c3e606e20b044e63b397fcdfc41fe050 2023-11-20 08:55:36,431 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/family2/c3e606e20b044e63b397fcdfc41fe050, entries=2, sequenceid=5, filesize=5.1 K 2023-11-20 08:55:36,432 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 7d61965cf9967510cc3eaf24947bb0ef in 851ms, sequenceid=5, compaction requested=false 2023-11-20 08:55:36,432 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-11-20 08:55:36,433 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7d61965cf9967510cc3eaf24947bb0ef: 2023-11-20 08:55:36,433 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1700470533458.7d61965cf9967510cc3eaf24947bb0ef. 2023-11-20 08:55:36,433 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-20 08:55:36,818 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231120b73074ff45524ab68bdfd70c54df1301 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20231120b73074ff45524ab68bdfd70c54df1301 2023-11-20 08:55:36,819 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231120f4dbe164faf440e5ab20cfe9299a1854 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231120f4dbe164faf440e5ab20cfe9299a1854 2023-11-20 08:55:37,223 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/.tmp/family2/c6985c6392cb401a8c9401b160da48b5 2023-11-20 08:55:37,224 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/.tmp/family2/d40192cade8246a7b9590240c9f0ce96 2023-11-20 08:55:37,228 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/.tmp/family1/d50ee8413982412599cbdd6b17520fd4 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/family1/d50ee8413982412599cbdd6b17520fd4 2023-11-20 08:55:37,228 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/.tmp/family1/3366b2be2edd432c8217b46a323fc446 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/family1/3366b2be2edd432c8217b46a323fc446 2023-11-20 08:55:37,232 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/family1/d50ee8413982412599cbdd6b17520fd4, entries=4, sequenceid=5, filesize=5.4 K 2023-11-20 08:55:37,232 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/family1/3366b2be2edd432c8217b46a323fc446, entries=4, sequenceid=5, filesize=5.4 K 2023-11-20 08:55:37,233 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/.tmp/family2/c6985c6392cb401a8c9401b160da48b5 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/family2/c6985c6392cb401a8c9401b160da48b5 2023-11-20 08:55:37,233 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/.tmp/family2/d40192cade8246a7b9590240c9f0ce96 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/family2/d40192cade8246a7b9590240c9f0ce96 2023-11-20 08:55:37,236 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/family2/c6985c6392cb401a8c9401b160da48b5, entries=2, sequenceid=5, filesize=5.1 K 2023-11-20 08:55:37,237 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/family2/d40192cade8246a7b9590240c9f0ce96, entries=2, sequenceid=5, filesize=5.1 K 2023-11-20 08:55:37,237 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for a4223368d0abcd3a665a863e674f7fce in 1655ms, sequenceid=5, compaction requested=false 2023-11-20 08:55:37,238 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for a4223368d0abcd3a665a863e674f7fce: 2023-11-20 08:55:37,238 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1700470533458.a4223368d0abcd3a665a863e674f7fce. 2023-11-20 08:55:37,238 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-20 08:55:37,238 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 37ddd3693eda6c49fa96f6147c47a803 in 1656ms, sequenceid=5, compaction requested=false 2023-11-20 08:55:37,238 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 37ddd3693eda6c49fa96f6147c47a803: 2023-11-20 08:55:37,238 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1700470533458.37ddd3693eda6c49fa96f6147c47a803. 2023-11-20 08:55:37,238 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-20 08:55:37,238 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-20 08:55:37,238 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:37,238 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-20 08:55:37,238 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-20 08:55:37,240 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:37,240 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-20 08:55:37,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:37,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:55:37,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:55:37,241 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-20 08:55:37,241 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:55:37,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:55:37,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:55:37,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-20 08:55:37,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:37,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:55:37,242 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-20 08:55:37,242 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2d6e4a8b[Count = 0] remaining members to acquire global barrier 2023-11-20 08:55:37,242 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-20 08:55:37,242 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-20 08:55:37,243 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-20 08:55:37,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-20 08:55:37,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-20 08:55:37,243 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-20 08:55:37,243 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-20 08:55:37,244 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:55:37,244 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:37,244 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:55:37,245 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-20 08:55:37,245 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:55:37,245 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:37,245 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-20 08:55:37,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:37,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:55:37,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:55:37,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:55:37,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:55:37,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-20 08:55:37,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:37,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:55:37,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-20 08:55:37,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:37,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:55:37,248 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-20 08:55:37,248 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-20 08:55:37,248 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:55:37,248 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:55:37,248 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-20 08:55:37,248 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:55:37,251 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-20 08:55:37,251 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-20 08:55:37,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-20 08:55:37,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-20 08:55:37,251 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:55:37,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-20 08:55:37,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:55:37,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:55:37,252 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:37,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:55:37,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:55:37,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:55:37,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-20 08:55:37,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-20 08:55:37,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:55:37,253 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:37,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-20 08:55:37,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:37,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:55:37,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-20 08:55:37,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:37,255 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:37,255 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:55:37,255 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-20 08:55:37,255 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-20 08:55:37,255 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:55:37,255 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:55:37,255 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:55:37,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:55:37,255 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-20 08:55:37,256 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:37,256 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-20 08:55:37,255 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:55:37,256 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:55:37,256 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-20 08:55:37,256 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-20 08:55:37,256 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:55:37,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:55:37,256 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-20 08:55:37,256 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-11-20 08:55:37,356 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:55:37,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:55:37,358 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38491] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1700470533458.37ddd3693eda6c49fa96f6147c47a803. with WAL disabled. Data may be lost in the event of a crash. 2023-11-20 08:55:37,358 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38491] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1700470533458.7d61965cf9967510cc3eaf24947bb0ef. with WAL disabled. Data may be lost in the event of a crash. 2023-11-20 08:55:37,358 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38491] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1700470533458.a4223368d0abcd3a665a863e674f7fce. with WAL disabled. Data may be lost in the event of a crash. 2023-11-20 08:55:37,361 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:55:37,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-20 08:55:37,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-20 08:55:37,363 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-20 08:55:37,363 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:55:37,363 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-20 08:55:37,363 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-20 08:55:37,363 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-20 08:55:37,363 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-20 08:55:37,365 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:55:37,365 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:37,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:55:37,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:55:37,365 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:37,365 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:55:37,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-20 08:55:37,366 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-20 08:55:37,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:55:37,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-20 08:55:37,366 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-20 08:55:37,366 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-20 08:55:37,366 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-20 08:55:37,366 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-20 08:55:37,366 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:55:37,367 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-20 08:55:37,367 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1700470533458.7d61965cf9967510cc3eaf24947bb0ef. 2023-11-20 08:55:37,367 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1700470533458.7d61965cf9967510cc3eaf24947bb0ef. started... 2023-11-20 08:55:37,367 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-20 08:55:37,367 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:55:37,367 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7d61965cf9967510cc3eaf24947bb0ef 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-20 08:55:37,367 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1700470533458.37ddd3693eda6c49fa96f6147c47a803. 2023-11-20 08:55:37,367 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1700470533458.a4223368d0abcd3a665a863e674f7fce. 2023-11-20 08:55:37,367 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1700470533458.37ddd3693eda6c49fa96f6147c47a803. started... 2023-11-20 08:55:37,367 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1700470533458.a4223368d0abcd3a665a863e674f7fce. started... 2023-11-20 08:55:37,367 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 37ddd3693eda6c49fa96f6147c47a803 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-20 08:55:37,367 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing a4223368d0abcd3a665a863e674f7fce 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-20 08:55:37,781 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231120344231cbd2b04f4481fb3ce30ac26bd2 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231120344231cbd2b04f4481fb3ce30ac26bd2 2023-11-20 08:55:37,788 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/.tmp/family1/6e46f06fa286400faf2ac21f48556493 2023-11-20 08:55:37,790 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231120ae33f73b4bf5420b986d8c2b8cc9ea33 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231120ae33f73b4bf5420b986d8c2b8cc9ea33 2023-11-20 08:55:37,791 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231120c188ad588ad84ff9ba08a355c6572b3b to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231120c188ad588ad84ff9ba08a355c6572b3b 2023-11-20 08:55:37,796 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/.tmp/family1/874b1a5edac440bd9960195776417fcb 2023-11-20 08:55:38,196 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/.tmp/family1/dba09dbf1ace4ed186598255b3ee61e2 2023-11-20 08:55:38,223 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023112015cb41e22bc743f3b564caaf12bb6d7b to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b2023112015cb41e22bc743f3b564caaf12bb6d7b 2023-11-20 08:55:38,226 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023112038e6ae950b6e4654a03a18183db09edd to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e2023112038e6ae950b6e4654a03a18183db09edd 2023-11-20 08:55:38,231 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/.tmp/family2/0855f07d404440a7b43d660f79875386 2023-11-20 08:55:38,234 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/.tmp/family1/874b1a5edac440bd9960195776417fcb as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/family1/874b1a5edac440bd9960195776417fcb 2023-11-20 08:55:38,237 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/family1/874b1a5edac440bd9960195776417fcb, entries=4, sequenceid=9, filesize=5.4 K 2023-11-20 08:55:38,238 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/.tmp/family2/0855f07d404440a7b43d660f79875386 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/family2/0855f07d404440a7b43d660f79875386 2023-11-20 08:55:38,241 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/family2/0855f07d404440a7b43d660f79875386, entries=2, sequenceid=9, filesize=5.1 K 2023-11-20 08:55:38,242 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 37ddd3693eda6c49fa96f6147c47a803 in 875ms, sequenceid=9, compaction requested=false 2023-11-20 08:55:38,242 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 37ddd3693eda6c49fa96f6147c47a803: 2023-11-20 08:55:38,242 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1700470533458.37ddd3693eda6c49fa96f6147c47a803. 2023-11-20 08:55:38,242 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-20 08:55:38,609 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231120bbe9e20f8b704e73895b4fe38e53af2d to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20231120bbe9e20f8b704e73895b4fe38e53af2d 2023-11-20 08:55:38,628 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/.tmp/family2/f8fc696b6bc947a4a2cc0eaf068eee9f 2023-11-20 08:55:38,632 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/.tmp/family1/6e46f06fa286400faf2ac21f48556493 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/family1/6e46f06fa286400faf2ac21f48556493 2023-11-20 08:55:38,635 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/family1/6e46f06fa286400faf2ac21f48556493, entries=4, sequenceid=9, filesize=5.4 K 2023-11-20 08:55:38,636 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/.tmp/family2/f8fc696b6bc947a4a2cc0eaf068eee9f as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/family2/f8fc696b6bc947a4a2cc0eaf068eee9f 2023-11-20 08:55:38,639 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/family2/f8fc696b6bc947a4a2cc0eaf068eee9f, entries=2, sequenceid=9, filesize=5.1 K 2023-11-20 08:55:38,639 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 7d61965cf9967510cc3eaf24947bb0ef in 1272ms, sequenceid=9, compaction requested=false 2023-11-20 08:55:38,640 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7d61965cf9967510cc3eaf24947bb0ef: 2023-11-20 08:55:38,640 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1700470533458.7d61965cf9967510cc3eaf24947bb0ef. 2023-11-20 08:55:38,640 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-20 08:55:39,014 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/.tmp/family2/bf981633222c4f62aee80e0ddb8a86bd 2023-11-20 08:55:39,018 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/.tmp/family1/dba09dbf1ace4ed186598255b3ee61e2 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/family1/dba09dbf1ace4ed186598255b3ee61e2 2023-11-20 08:55:39,021 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/family1/dba09dbf1ace4ed186598255b3ee61e2, entries=4, sequenceid=9, filesize=5.4 K 2023-11-20 08:55:39,022 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/.tmp/family2/bf981633222c4f62aee80e0ddb8a86bd as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/family2/bf981633222c4f62aee80e0ddb8a86bd 2023-11-20 08:55:39,025 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/family2/bf981633222c4f62aee80e0ddb8a86bd, entries=2, sequenceid=9, filesize=5.1 K 2023-11-20 08:55:39,026 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for a4223368d0abcd3a665a863e674f7fce in 1659ms, sequenceid=9, compaction requested=false 2023-11-20 08:55:39,026 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for a4223368d0abcd3a665a863e674f7fce: 2023-11-20 08:55:39,026 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1700470533458.a4223368d0abcd3a665a863e674f7fce. 2023-11-20 08:55:39,026 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-20 08:55:39,026 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-20 08:55:39,026 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:39,026 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-20 08:55:39,026 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-20 08:55:39,028 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:39,028 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-20 08:55:39,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:39,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:55:39,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:55:39,028 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-20 08:55:39,028 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:55:39,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:55:39,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:55:39,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-20 08:55:39,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:39,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:55:39,029 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-20 08:55:39,029 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@701096b6[Count = 0] remaining members to acquire global barrier 2023-11-20 08:55:39,029 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-20 08:55:39,029 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-20 08:55:39,036 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-20 08:55:39,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-20 08:55:39,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-20 08:55:39,037 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-20 08:55:39,037 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-20 08:55:39,037 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:39,037 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:55:39,037 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:55:39,038 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:39,038 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-20 08:55:39,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:39,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:55:39,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:55:39,038 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:55:39,038 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-20 08:55:39,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:55:39,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:55:39,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-20 08:55:39,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:39,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:55:39,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-20 08:55:39,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:39,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:55:39,040 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-20 08:55:39,040 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-20 08:55:39,040 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:55:39,040 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:55:39,040 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-20 08:55:39,040 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:55:39,042 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-20 08:55:39,042 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-20 08:55:39,042 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:55:39,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-20 08:55:39,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-20 08:55:39,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:55:39,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:55:39,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-20 08:55:39,042 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:39,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:55:39,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:55:39,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:55:39,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-20 08:55:39,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-20 08:55:39,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:55:39,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-20 08:55:39,044 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:39,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:39,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:55:39,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-20 08:55:39,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:39,046 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:39,046 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:55:39,046 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:55:39,046 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-20 08:55:39,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:55:39,046 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-20 08:55:39,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:55:39,046 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-11-20 08:55:39,046 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:55:39,046 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-20 08:55:39,046 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:55:39,046 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:39,047 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-20 08:55:39,047 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-20 08:55:39,047 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-20 08:55:39,047 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-20 08:55:39,047 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:55:39,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:55:39,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:55:39,147 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:55:39,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:55:39,149 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38491] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1700470533458.37ddd3693eda6c49fa96f6147c47a803. with WAL disabled. Data may be lost in the event of a crash. 2023-11-20 08:55:39,149 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38491] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1700470533458.7d61965cf9967510cc3eaf24947bb0ef. with WAL disabled. Data may be lost in the event of a crash. 2023-11-20 08:55:39,149 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38491] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1700470533458.a4223368d0abcd3a665a863e674f7fce. with WAL disabled. Data may be lost in the event of a crash. 2023-11-20 08:55:39,152 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:55:39,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-20 08:55:39,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-20 08:55:39,153 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-20 08:55:39,154 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:55:39,154 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-20 08:55:39,154 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-20 08:55:39,154 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-20 08:55:39,154 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-20 08:55:39,157 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:39,157 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:55:39,157 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:55:39,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:55:39,158 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:39,158 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:55:39,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-20 08:55:39,158 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-20 08:55:39,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:55:39,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-20 08:55:39,158 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-20 08:55:39,159 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-20 08:55:39,159 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-20 08:55:39,159 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-20 08:55:39,159 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:55:39,159 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-20 08:55:39,160 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1700470533458.7d61965cf9967510cc3eaf24947bb0ef. 2023-11-20 08:55:39,160 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1700470533458.7d61965cf9967510cc3eaf24947bb0ef. started... 2023-11-20 08:55:39,160 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1700470533458.37ddd3693eda6c49fa96f6147c47a803. 2023-11-20 08:55:39,160 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-20 08:55:39,160 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1700470533458.a4223368d0abcd3a665a863e674f7fce. 2023-11-20 08:55:39,160 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1700470533458.a4223368d0abcd3a665a863e674f7fce. started... 2023-11-20 08:55:39,160 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:55:39,160 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7d61965cf9967510cc3eaf24947bb0ef 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-20 08:55:39,160 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1700470533458.37ddd3693eda6c49fa96f6147c47a803. started... 2023-11-20 08:55:39,160 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing a4223368d0abcd3a665a863e674f7fce 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-20 08:55:39,160 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 37ddd3693eda6c49fa96f6147c47a803 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-20 08:55:39,579 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023112045fe245de68a4fafbc09810aa1636bec to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023112045fe245de68a4fafbc09810aa1636bec 2023-11-20 08:55:39,586 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231120b66c06b3a119449cbb94f54ee319a055 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231120b66c06b3a119449cbb94f54ee319a055 2023-11-20 08:55:39,586 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231120f373a898311a4636960b58504f31741a to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231120f373a898311a4636960b58504f31741a 2023-11-20 08:55:39,984 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/.tmp/family1/0bc2c1796ef240bfa456d805b498af39 2023-11-20 08:55:39,996 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/.tmp/family1/3e9113abdcbc4f84a2e7e7b0a3240db8 2023-11-20 08:55:40,002 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/.tmp/family1/3b2b098619e748498668c98b516e1c3a 2023-11-20 08:55:40,009 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231120c482f1feb77d49e9b105fb4a8d36546e to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20231120c482f1feb77d49e9b105fb4a8d36546e 2023-11-20 08:55:40,113 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-20 08:55:40,142 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-20 08:55:40,142 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3447fbd5 to 127.0.0.1:64635 2023-11-20 08:55:40,142 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-20 08:55:40,142 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-20 08:55:40,142 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x52b525e0 to 127.0.0.1:64635 2023-11-20 08:55:40,143 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-20 08:55:40,143 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-20 08:55:40,144 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4b30df42 to 127.0.0.1:64635 2023-11-20 08:55:40,144 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-20 08:55:40,401 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231120817c8ed63e4c48458a9c36d0de7a7bf4 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231120817c8ed63e4c48458a9c36d0de7a7bf4 2023-11-20 08:55:40,416 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/.tmp/family2/44c5112a22284eb7a229a3437e2ed6a5 2023-11-20 08:55:40,419 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231120391454db10e54f7d82254b5953577096 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231120391454db10e54f7d82254b5953577096 2023-11-20 08:55:40,420 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/.tmp/family1/3e9113abdcbc4f84a2e7e7b0a3240db8 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/family1/3e9113abdcbc4f84a2e7e7b0a3240db8 2023-11-20 08:55:40,423 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/family1/3e9113abdcbc4f84a2e7e7b0a3240db8, entries=4, sequenceid=13, filesize=5.4 K 2023-11-20 08:55:40,424 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/.tmp/family2/7264b9257c08456da42bfe3a81c237ee 2023-11-20 08:55:40,424 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/.tmp/family2/44c5112a22284eb7a229a3437e2ed6a5 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/family2/44c5112a22284eb7a229a3437e2ed6a5 2023-11-20 08:55:40,428 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/.tmp/family1/3b2b098619e748498668c98b516e1c3a as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/family1/3b2b098619e748498668c98b516e1c3a 2023-11-20 08:55:40,428 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/family2/44c5112a22284eb7a229a3437e2ed6a5, entries=2, sequenceid=13, filesize=5.1 K 2023-11-20 08:55:40,429 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for a4223368d0abcd3a665a863e674f7fce in 1269ms, sequenceid=13, compaction requested=true 2023-11-20 08:55:40,429 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for a4223368d0abcd3a665a863e674f7fce: 2023-11-20 08:55:40,429 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1700470533458.a4223368d0abcd3a665a863e674f7fce. 2023-11-20 08:55:40,429 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-20 08:55:40,431 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/family1/3b2b098619e748498668c98b516e1c3a, entries=4, sequenceid=13, filesize=5.4 K 2023-11-20 08:55:40,432 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/.tmp/family2/7264b9257c08456da42bfe3a81c237ee as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/family2/7264b9257c08456da42bfe3a81c237ee 2023-11-20 08:55:40,435 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/family2/7264b9257c08456da42bfe3a81c237ee, entries=2, sequenceid=13, filesize=5.1 K 2023-11-20 08:55:40,436 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 37ddd3693eda6c49fa96f6147c47a803 in 1276ms, sequenceid=13, compaction requested=true 2023-11-20 08:55:40,436 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 37ddd3693eda6c49fa96f6147c47a803: 2023-11-20 08:55:40,436 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1700470533458.37ddd3693eda6c49fa96f6147c47a803. 2023-11-20 08:55:40,436 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-20 08:55:40,806 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/.tmp/family2/b31e2bd3abc54feebe49fd970fa6c643 2023-11-20 08:55:40,811 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/.tmp/family1/0bc2c1796ef240bfa456d805b498af39 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/family1/0bc2c1796ef240bfa456d805b498af39 2023-11-20 08:55:40,814 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/family1/0bc2c1796ef240bfa456d805b498af39, entries=4, sequenceid=13, filesize=5.4 K 2023-11-20 08:55:40,815 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/.tmp/family2/b31e2bd3abc54feebe49fd970fa6c643 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/family2/b31e2bd3abc54feebe49fd970fa6c643 2023-11-20 08:55:40,818 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/family2/b31e2bd3abc54feebe49fd970fa6c643, entries=2, sequenceid=13, filesize=5.1 K 2023-11-20 08:55:40,819 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 7d61965cf9967510cc3eaf24947bb0ef in 1659ms, sequenceid=13, compaction requested=true 2023-11-20 08:55:40,819 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7d61965cf9967510cc3eaf24947bb0ef: 2023-11-20 08:55:40,819 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1700470533458.7d61965cf9967510cc3eaf24947bb0ef. 2023-11-20 08:55:40,819 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-20 08:55:40,819 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-20 08:55:40,819 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:40,819 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-20 08:55:40,820 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-20 08:55:40,826 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:40,826 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-20 08:55:40,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:40,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:55:40,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:55:40,827 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-20 08:55:40,827 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:55:40,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:55:40,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:55:40,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-20 08:55:40,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:40,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:55:40,828 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-20 08:55:40,828 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5f0c0ce0[Count = 0] remaining members to acquire global barrier 2023-11-20 08:55:40,828 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-20 08:55:40,828 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-20 08:55:40,829 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-20 08:55:40,829 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-20 08:55:40,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-20 08:55:40,829 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-20 08:55:40,829 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-20 08:55:40,829 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:55:40,830 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:40,830 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:55:40,831 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-20 08:55:40,831 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:40,831 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:55:40,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:40,831 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-20 08:55:40,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:55:40,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:55:40,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:55:40,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:55:40,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-20 08:55:40,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:40,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:55:40,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-20 08:55:40,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:40,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:55:40,833 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-20 08:55:40,833 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-20 08:55:40,833 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:55:40,833 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:55:40,834 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-20 08:55:40,834 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:55:40,839 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-20 08:55:40,839 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-20 08:55:40,839 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:55:40,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-20 08:55:40,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:55:40,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:55:40,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-20 08:55:40,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-20 08:55:40,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:55:40,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:55:40,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:55:40,840 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:40,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-20 08:55:40,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-20 08:55:40,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:55:40,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-20 08:55:40,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:40,841 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:40,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:55:40,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-20 08:55:40,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:40,843 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:40,843 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-20 08:55:40,843 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:55:40,843 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-20 08:55:40,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:55:40,843 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-20 08:55:40,844 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:55:40,843 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:55:40,843 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:40,843 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:55:40,844 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-20 08:55:40,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:55:40,844 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-20 08:55:40,844 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-20 08:55:40,844 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-20 08:55:40,844 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:55:40,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:55:40,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:55:40,944 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:55:40,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:55:40,946 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38491] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1700470533458.37ddd3693eda6c49fa96f6147c47a803. with WAL disabled. Data may be lost in the event of a crash. 2023-11-20 08:55:40,946 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38491] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1700470533458.7d61965cf9967510cc3eaf24947bb0ef. with WAL disabled. Data may be lost in the event of a crash. 2023-11-20 08:55:40,946 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38491] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1700470533458.a4223368d0abcd3a665a863e674f7fce. with WAL disabled. Data may be lost in the event of a crash. 2023-11-20 08:55:40,948 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:55:40,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-20 08:55:40,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-20 08:55:40,950 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-20 08:55:40,950 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:55:40,950 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-20 08:55:40,950 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-20 08:55:40,950 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-20 08:55:40,950 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-20 08:55:40,952 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:40,952 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:55:40,952 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:55:40,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:55:40,952 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:40,952 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:55:40,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-20 08:55:40,953 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-20 08:55:40,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:55:40,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-20 08:55:40,953 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-20 08:55:40,953 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-20 08:55:40,953 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-20 08:55:40,953 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-20 08:55:40,953 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:55:40,953 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-20 08:55:40,954 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1700470533458.7d61965cf9967510cc3eaf24947bb0ef. 2023-11-20 08:55:40,954 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1700470533458.37ddd3693eda6c49fa96f6147c47a803. 2023-11-20 08:55:40,954 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1700470533458.37ddd3693eda6c49fa96f6147c47a803. started... 2023-11-20 08:55:40,954 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-20 08:55:40,954 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:55:40,954 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1700470533458.7d61965cf9967510cc3eaf24947bb0ef. started... 2023-11-20 08:55:40,954 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 37ddd3693eda6c49fa96f6147c47a803 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-20 08:55:40,954 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1700470533458.a4223368d0abcd3a665a863e674f7fce. 2023-11-20 08:55:40,954 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7d61965cf9967510cc3eaf24947bb0ef 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-20 08:55:40,954 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1700470533458.a4223368d0abcd3a665a863e674f7fce. started... 2023-11-20 08:55:40,954 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing a4223368d0abcd3a665a863e674f7fce 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-20 08:55:40,968 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311208ca0bc4d603341ec8bbd6e8e51290bb3 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202311208ca0bc4d603341ec8bbd6e8e51290bb3 2023-11-20 08:55:41,365 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311205be870a0fc6343f6bffd96c8deb235aa to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202311205be870a0fc6343f6bffd96c8deb235aa 2023-11-20 08:55:41,365 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231120e96066368aee404393d96658f7dc2061 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231120e96066368aee404393d96658f7dc2061 2023-11-20 08:55:41,372 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/.tmp/family1/2dee5034f0114339a1f0f26cb9eebfbd 2023-11-20 08:55:41,770 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/.tmp/family1/ede512f2f8ec41c9801f9d3ba3e9cefb 2023-11-20 08:55:41,770 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/.tmp/family1/a0e986abca514f6aaf94af105a1588f4 2023-11-20 08:55:41,784 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311205fd910e71bf04056a0518a711f59cb47 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202311205fd910e71bf04056a0518a711f59cb47 2023-11-20 08:55:41,785 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311207b883c1f2d764e228ecf1a31949ea182 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202311207b883c1f2d764e228ecf1a31949ea182 2023-11-20 08:55:42,184 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311200aa2d9c6d42a410c87ac7d9ba37a85ed to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202311200aa2d9c6d42a410c87ac7d9ba37a85ed 2023-11-20 08:55:42,188 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/.tmp/family2/833d47799c96449cbd893c5d55535638 2023-11-20 08:55:42,189 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/.tmp/family2/8835f68a6c334517b9f2895ed2248d58 2023-11-20 08:55:42,193 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/.tmp/family1/2dee5034f0114339a1f0f26cb9eebfbd as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/family1/2dee5034f0114339a1f0f26cb9eebfbd 2023-11-20 08:55:42,193 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/.tmp/family1/a0e986abca514f6aaf94af105a1588f4 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/family1/a0e986abca514f6aaf94af105a1588f4 2023-11-20 08:55:42,197 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/family1/2dee5034f0114339a1f0f26cb9eebfbd, entries=4, sequenceid=17, filesize=5.4 K 2023-11-20 08:55:42,197 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/family1/a0e986abca514f6aaf94af105a1588f4, entries=4, sequenceid=17, filesize=5.4 K 2023-11-20 08:55:42,197 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/.tmp/family2/8835f68a6c334517b9f2895ed2248d58 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/family2/8835f68a6c334517b9f2895ed2248d58 2023-11-20 08:55:42,197 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/.tmp/family2/833d47799c96449cbd893c5d55535638 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/family2/833d47799c96449cbd893c5d55535638 2023-11-20 08:55:42,201 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/family2/8835f68a6c334517b9f2895ed2248d58, entries=2, sequenceid=17, filesize=5.1 K 2023-11-20 08:55:42,201 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/family2/833d47799c96449cbd893c5d55535638, entries=2, sequenceid=17, filesize=5.1 K 2023-11-20 08:55:42,201 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 7d61965cf9967510cc3eaf24947bb0ef in 1247ms, sequenceid=17, compaction requested=true 2023-11-20 08:55:42,201 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for a4223368d0abcd3a665a863e674f7fce in 1247ms, sequenceid=17, compaction requested=true 2023-11-20 08:55:42,202 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7d61965cf9967510cc3eaf24947bb0ef: 2023-11-20 08:55:42,202 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for a4223368d0abcd3a665a863e674f7fce: 2023-11-20 08:55:42,202 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1700470533458.a4223368d0abcd3a665a863e674f7fce. 2023-11-20 08:55:42,202 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1700470533458.7d61965cf9967510cc3eaf24947bb0ef. 2023-11-20 08:55:42,202 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-20 08:55:42,202 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-20 08:55:42,589 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/.tmp/family2/4d5242e17dfb437dbfbe35c55cd51b6c 2023-11-20 08:55:42,593 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/.tmp/family1/ede512f2f8ec41c9801f9d3ba3e9cefb as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/family1/ede512f2f8ec41c9801f9d3ba3e9cefb 2023-11-20 08:55:42,596 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/family1/ede512f2f8ec41c9801f9d3ba3e9cefb, entries=4, sequenceid=17, filesize=5.4 K 2023-11-20 08:55:42,596 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/.tmp/family2/4d5242e17dfb437dbfbe35c55cd51b6c as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/family2/4d5242e17dfb437dbfbe35c55cd51b6c 2023-11-20 08:55:42,599 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/family2/4d5242e17dfb437dbfbe35c55cd51b6c, entries=2, sequenceid=17, filesize=5.1 K 2023-11-20 08:55:42,600 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 37ddd3693eda6c49fa96f6147c47a803 in 1646ms, sequenceid=17, compaction requested=true 2023-11-20 08:55:42,600 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 37ddd3693eda6c49fa96f6147c47a803: 2023-11-20 08:55:42,600 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1700470533458.37ddd3693eda6c49fa96f6147c47a803. 2023-11-20 08:55:42,600 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-20 08:55:42,600 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-20 08:55:42,600 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:42,601 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-20 08:55:42,601 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-20 08:55:42,602 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:42,602 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-20 08:55:42,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:42,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:55:42,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:55:42,602 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-20 08:55:42,602 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:55:42,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:55:42,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:55:42,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-20 08:55:42,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:42,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:55:42,604 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-20 08:55:42,604 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@625cb3e8[Count = 0] remaining members to acquire global barrier 2023-11-20 08:55:42,604 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-20 08:55:42,604 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-20 08:55:42,606 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-20 08:55:42,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-20 08:55:42,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-20 08:55:42,606 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-20 08:55:42,606 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-20 08:55:42,606 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:42,606 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:55:42,606 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:55:42,608 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:42,608 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-20 08:55:42,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:42,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:55:42,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:55:42,608 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:55:42,608 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-20 08:55:42,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:55:42,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:55:42,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-20 08:55:42,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:42,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:55:42,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-20 08:55:42,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:42,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:55:42,610 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-20 08:55:42,610 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-20 08:55:42,610 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:55:42,610 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:55:42,610 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-20 08:55:42,610 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:55:42,612 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-20 08:55:42,612 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-20 08:55:42,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-20 08:55:42,612 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:55:42,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:55:42,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:55:42,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-20 08:55:42,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-20 08:55:42,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:55:42,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:55:42,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:55:42,613 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:42,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-20 08:55:42,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-20 08:55:42,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:55:42,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-20 08:55:42,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:42,614 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:42,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:55:42,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-20 08:55:42,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:42,617 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:42,617 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:55:42,617 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-20 08:55:42,617 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:55:42,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:55:42,617 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:55:42,617 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-20 08:55:42,617 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:55:42,617 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:55:42,617 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-20 08:55:42,617 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:42,617 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-20 08:55:42,617 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-20 08:55:42,617 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-20 08:55:42,617 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-20 08:55:42,617 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:55:42,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:55:42,624 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-11-20 08:55:42,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:55:42,718 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:55:42,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:55:42,726 DEBUG [Listener at localhost/43513] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-20 08:55:42,732 DEBUG [Listener at localhost/43513] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-20 08:55:42,739 DEBUG [Listener at localhost/43513] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-20 08:55:42,740 DEBUG [Listener at localhost/43513] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-20 08:55:42,765 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:55:42,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-20 08:55:42,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-20 08:55:42,767 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-20 08:55:42,767 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:55:42,767 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-20 08:55:42,767 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-20 08:55:42,767 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-20 08:55:42,767 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-20 08:55:42,773 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:55:42,773 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:42,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:55:42,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:55:42,774 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:42,774 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:55:42,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-20 08:55:42,774 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-20 08:55:42,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:55:42,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-20 08:55:42,775 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-20 08:55:42,775 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-20 08:55:42,775 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-20 08:55:42,775 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-20 08:55:42,775 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:55:42,775 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-20 08:55:42,775 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1700470533458.7d61965cf9967510cc3eaf24947bb0ef. 2023-11-20 08:55:42,775 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1700470533458.37ddd3693eda6c49fa96f6147c47a803. 2023-11-20 08:55:42,775 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1700470533458.a4223368d0abcd3a665a863e674f7fce. 2023-11-20 08:55:42,775 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1700470533458.37ddd3693eda6c49fa96f6147c47a803. started... 2023-11-20 08:55:42,775 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1700470533458.a4223368d0abcd3a665a863e674f7fce. started... 2023-11-20 08:55:42,775 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1700470533458.7d61965cf9967510cc3eaf24947bb0ef. started... 2023-11-20 08:55:42,776 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 37ddd3693eda6c49fa96f6147c47a803 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-20 08:55:42,775 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-20 08:55:42,776 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:55:42,776 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7d61965cf9967510cc3eaf24947bb0ef 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-20 08:55:42,776 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing a4223368d0abcd3a665a863e674f7fce 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-20 08:55:43,594 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/.tmp/family1/4bd1badc4fd64eca9d05cc992bf52cd2 2023-11-20 08:55:43,594 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/.tmp/family1/e68e4e0692db4eaca83ffdb435461f6d 2023-11-20 08:55:43,594 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/.tmp/family1/00dacb7e0dbd4b0ab3c478c8a7779cb6 2023-11-20 08:55:43,598 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4bd1badc4fd64eca9d05cc992bf52cd2 2023-11-20 08:55:43,598 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 00dacb7e0dbd4b0ab3c478c8a7779cb6 2023-11-20 08:55:43,598 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e68e4e0692db4eaca83ffdb435461f6d 2023-11-20 08:55:44,415 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/.tmp/family2/14f0ee445bbb413fafa866fa21e5ad13 2023-11-20 08:55:44,415 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/.tmp/family2/27b49d28aaf94373b79d26ee4787fd94 2023-11-20 08:55:44,416 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/.tmp/family2/81a868e2b57e450c8694f9ac389965dc 2023-11-20 08:55:44,419 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 27b49d28aaf94373b79d26ee4787fd94 2023-11-20 08:55:44,419 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 81a868e2b57e450c8694f9ac389965dc 2023-11-20 08:55:44,420 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 14f0ee445bbb413fafa866fa21e5ad13 2023-11-20 08:55:44,420 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/.tmp/family1/00dacb7e0dbd4b0ab3c478c8a7779cb6 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/family1/00dacb7e0dbd4b0ab3c478c8a7779cb6 2023-11-20 08:55:44,420 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/.tmp/family1/e68e4e0692db4eaca83ffdb435461f6d as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/family1/e68e4e0692db4eaca83ffdb435461f6d 2023-11-20 08:55:44,420 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/.tmp/family1/4bd1badc4fd64eca9d05cc992bf52cd2 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/family1/4bd1badc4fd64eca9d05cc992bf52cd2 2023-11-20 08:55:44,424 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e68e4e0692db4eaca83ffdb435461f6d 2023-11-20 08:55:44,424 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4bd1badc4fd64eca9d05cc992bf52cd2 2023-11-20 08:55:44,424 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/family1/e68e4e0692db4eaca83ffdb435461f6d, entries=3, sequenceid=23, filesize=5.0 K 2023-11-20 08:55:44,424 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 00dacb7e0dbd4b0ab3c478c8a7779cb6 2023-11-20 08:55:44,424 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/family1/4bd1badc4fd64eca9d05cc992bf52cd2, entries=3, sequenceid=23, filesize=5.0 K 2023-11-20 08:55:44,424 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/family1/00dacb7e0dbd4b0ab3c478c8a7779cb6, entries=3, sequenceid=23, filesize=5.0 K 2023-11-20 08:55:44,425 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/.tmp/family2/81a868e2b57e450c8694f9ac389965dc as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/family2/81a868e2b57e450c8694f9ac389965dc 2023-11-20 08:55:44,425 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/.tmp/family2/14f0ee445bbb413fafa866fa21e5ad13 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/family2/14f0ee445bbb413fafa866fa21e5ad13 2023-11-20 08:55:44,425 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/.tmp/family2/27b49d28aaf94373b79d26ee4787fd94 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/family2/27b49d28aaf94373b79d26ee4787fd94 2023-11-20 08:55:44,433 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 81a868e2b57e450c8694f9ac389965dc 2023-11-20 08:55:44,433 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/family2/81a868e2b57e450c8694f9ac389965dc, entries=1, sequenceid=23, filesize=5.0 K 2023-11-20 08:55:44,433 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 14f0ee445bbb413fafa866fa21e5ad13 2023-11-20 08:55:44,433 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/family2/14f0ee445bbb413fafa866fa21e5ad13, entries=1, sequenceid=23, filesize=5.0 K 2023-11-20 08:55:44,433 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 27b49d28aaf94373b79d26ee4787fd94 2023-11-20 08:55:44,433 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/family2/27b49d28aaf94373b79d26ee4787fd94, entries=1, sequenceid=23, filesize=5.0 K 2023-11-20 08:55:44,434 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 37ddd3693eda6c49fa96f6147c47a803 in 1658ms, sequenceid=23, compaction requested=true 2023-11-20 08:55:44,434 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 7d61965cf9967510cc3eaf24947bb0ef in 1658ms, sequenceid=23, compaction requested=true 2023-11-20 08:55:44,434 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 37ddd3693eda6c49fa96f6147c47a803: 2023-11-20 08:55:44,434 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7d61965cf9967510cc3eaf24947bb0ef: 2023-11-20 08:55:44,434 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for a4223368d0abcd3a665a863e674f7fce in 1658ms, sequenceid=23, compaction requested=true 2023-11-20 08:55:44,434 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1700470533458.7d61965cf9967510cc3eaf24947bb0ef. 2023-11-20 08:55:44,434 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for a4223368d0abcd3a665a863e674f7fce: 2023-11-20 08:55:44,434 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1700470533458.37ddd3693eda6c49fa96f6147c47a803. 2023-11-20 08:55:44,434 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1700470533458.a4223368d0abcd3a665a863e674f7fce. 2023-11-20 08:55:44,434 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-20 08:55:44,434 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-20 08:55:44,434 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-20 08:55:44,434 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-20 08:55:44,434 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:44,434 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-20 08:55:44,434 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-20 08:55:44,436 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-20 08:55:44,436 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:44,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:44,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:55:44,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:55:44,436 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-20 08:55:44,436 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:55:44,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:55:44,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:55:44,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-20 08:55:44,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:44,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:55:44,438 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-20 08:55:44,438 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@76bc6dcc[Count = 0] remaining members to acquire global barrier 2023-11-20 08:55:44,438 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-20 08:55:44,438 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-20 08:55:44,439 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-20 08:55:44,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-20 08:55:44,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-20 08:55:44,439 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-20 08:55:44,439 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-20 08:55:44,439 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:55:44,439 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:44,439 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:55:44,440 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-20 08:55:44,440 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:44,440 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:55:44,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:44,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:55:44,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:55:44,440 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-20 08:55:44,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:55:44,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:55:44,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-20 08:55:44,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:44,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:55:44,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-20 08:55:44,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:44,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:55:44,443 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-20 08:55:44,443 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-20 08:55:44,443 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:55:44,443 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:55:44,443 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-20 08:55:44,443 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:55:44,446 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-20 08:55:44,446 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-20 08:55:44,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-20 08:55:44,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:55:44,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:55:44,446 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:55:44,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-20 08:55:44,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-20 08:55:44,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:55:44,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:55:44,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:55:44,446 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:44,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-20 08:55:44,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-20 08:55:44,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:55:44,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-20 08:55:44,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:44,448 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:44,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:55:44,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-20 08:55:44,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:44,450 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:44,450 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-20 08:55:44,450 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-20 08:55:44,450 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:55:44,450 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:55:44,450 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:44,450 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-20 08:55:44,450 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-20 08:55:44,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:55:44,450 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:55:44,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:55:44,450 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-20 08:55:44,450 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:55:44,450 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-20 08:55:44,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:55:44,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:55:44,451 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-20 08:55:44,451 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:55:44,551 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:55:44,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:55:44,552 DEBUG [Listener at localhost/43513] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-20 08:55:44,552 DEBUG [Listener at localhost/43513] regionserver.HStore(1912): 7d61965cf9967510cc3eaf24947bb0ef/family1 is initiating major compaction (all files) 2023-11-20 08:55:44,552 INFO [Listener at localhost/43513] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-20 08:55:44,552 INFO [Listener at localhost/43513] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-20 08:55:44,553 INFO [Listener at localhost/43513] regionserver.HRegion(2259): Starting compaction of 7d61965cf9967510cc3eaf24947bb0ef/family1 in ns:testMinorCompaction,1,1700470533458.7d61965cf9967510cc3eaf24947bb0ef. 2023-11-20 08:55:44,553 INFO [Listener at localhost/43513] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/family1/b004f06d04c74bc0a98c5139477f3320, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/family1/6e46f06fa286400faf2ac21f48556493, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/family1/0bc2c1796ef240bfa456d805b498af39, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/family1/a0e986abca514f6aaf94af105a1588f4, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/family1/4bd1badc4fd64eca9d05cc992bf52cd2] into tmpdir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/.tmp, totalSize=26.6 K 2023-11-20 08:55:44,554 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting b004f06d04c74bc0a98c5139477f3320, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700470535572 2023-11-20 08:55:44,554 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting 6e46f06fa286400faf2ac21f48556493, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700470537358 2023-11-20 08:55:44,555 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting 0bc2c1796ef240bfa456d805b498af39, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700470539149 2023-11-20 08:55:44,555 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting a0e986abca514f6aaf94af105a1588f4, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700470540946 2023-11-20 08:55:44,555 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting 4bd1badc4fd64eca9d05cc992bf52cd2, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-20 08:55:44,564 INFO [Listener at localhost/43513] throttle.PressureAwareThroughputController(145): 7d61965cf9967510cc3eaf24947bb0ef#family1#compaction#149 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-20 08:55:44,972 INFO [Listener at localhost/43513] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202311202caa832b0fe6471a95f8f3f8e5bcea10_del 2023-11-20 08:55:44,972 INFO [Listener at localhost/43513] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311202caa832b0fe6471a95f8f3f8e5bcea10_del to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202311202caa832b0fe6471a95f8f3f8e5bcea10_del 2023-11-20 08:55:45,785 INFO [Listener at localhost/43513] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 759c73b9a8d3465b970a80518d678353 2023-11-20 08:55:45,786 DEBUG [Listener at localhost/43513] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/.tmp/family1/759c73b9a8d3465b970a80518d678353 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/family1/759c73b9a8d3465b970a80518d678353 2023-11-20 08:55:45,789 INFO [Listener at localhost/43513] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 759c73b9a8d3465b970a80518d678353 2023-11-20 08:55:45,790 INFO [Listener at localhost/43513] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 7d61965cf9967510cc3eaf24947bb0ef/family1 of 7d61965cf9967510cc3eaf24947bb0ef into 759c73b9a8d3465b970a80518d678353(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-20 08:55:45,790 DEBUG [Listener at localhost/43513] regionserver.HRegion(2289): Compaction status journal for 7d61965cf9967510cc3eaf24947bb0ef: 2023-11-20 08:55:45,790 DEBUG [Listener at localhost/43513] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-20 08:55:45,791 DEBUG [Listener at localhost/43513] regionserver.HStore(1912): 7d61965cf9967510cc3eaf24947bb0ef/family2 is initiating major compaction (all files) 2023-11-20 08:55:45,791 INFO [Listener at localhost/43513] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-20 08:55:45,791 INFO [Listener at localhost/43513] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-20 08:55:45,791 INFO [Listener at localhost/43513] regionserver.HRegion(2259): Starting compaction of 7d61965cf9967510cc3eaf24947bb0ef/family2 in ns:testMinorCompaction,1,1700470533458.7d61965cf9967510cc3eaf24947bb0ef. 2023-11-20 08:55:45,791 INFO [Listener at localhost/43513] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/family2/c3e606e20b044e63b397fcdfc41fe050, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/family2/f8fc696b6bc947a4a2cc0eaf068eee9f, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/family2/b31e2bd3abc54feebe49fd970fa6c643, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/family2/8835f68a6c334517b9f2895ed2248d58, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/family2/14f0ee445bbb413fafa866fa21e5ad13] into tmpdir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/.tmp, totalSize=25.3 K 2023-11-20 08:55:45,791 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting c3e606e20b044e63b397fcdfc41fe050, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700470535572 2023-11-20 08:55:45,791 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting f8fc696b6bc947a4a2cc0eaf068eee9f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700470537358 2023-11-20 08:55:45,792 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting b31e2bd3abc54feebe49fd970fa6c643, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700470539149 2023-11-20 08:55:45,792 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting 8835f68a6c334517b9f2895ed2248d58, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700470540946 2023-11-20 08:55:45,792 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting 14f0ee445bbb413fafa866fa21e5ad13, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-20 08:55:45,799 INFO [Listener at localhost/43513] throttle.PressureAwareThroughputController(145): 7d61965cf9967510cc3eaf24947bb0ef#family2#compaction#150 average throughput is 1.02 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-20 08:55:45,826 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/family1/b004f06d04c74bc0a98c5139477f3320, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/family1/6e46f06fa286400faf2ac21f48556493, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/family1/0bc2c1796ef240bfa456d805b498af39, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/family1/a0e986abca514f6aaf94af105a1588f4, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/family1/4bd1badc4fd64eca9d05cc992bf52cd2] to archive 2023-11-20 08:55:45,826 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:55:45,828 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/family1/b004f06d04c74bc0a98c5139477f3320 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/family1/b004f06d04c74bc0a98c5139477f3320 2023-11-20 08:55:45,829 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/family1/6e46f06fa286400faf2ac21f48556493 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/family1/6e46f06fa286400faf2ac21f48556493 2023-11-20 08:55:45,829 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/family1/0bc2c1796ef240bfa456d805b498af39 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/family1/0bc2c1796ef240bfa456d805b498af39 2023-11-20 08:55:45,830 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/family1/a0e986abca514f6aaf94af105a1588f4 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/family1/a0e986abca514f6aaf94af105a1588f4 2023-11-20 08:55:45,831 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/family1/4bd1badc4fd64eca9d05cc992bf52cd2 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/family1/4bd1badc4fd64eca9d05cc992bf52cd2 2023-11-20 08:55:46,207 INFO [Listener at localhost/43513] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231120847f3637e702474fb39d771dbc35ca63_del 2023-11-20 08:55:46,207 INFO [Listener at localhost/43513] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231120847f3637e702474fb39d771dbc35ca63_del to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231120847f3637e702474fb39d771dbc35ca63_del 2023-11-20 08:55:47,020 INFO [Listener at localhost/43513] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8eea7783b8184a17975eacc83870ea88 2023-11-20 08:55:47,021 DEBUG [Listener at localhost/43513] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/.tmp/family2/8eea7783b8184a17975eacc83870ea88 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/family2/8eea7783b8184a17975eacc83870ea88 2023-11-20 08:55:47,024 INFO [Listener at localhost/43513] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8eea7783b8184a17975eacc83870ea88 2023-11-20 08:55:47,024 INFO [Listener at localhost/43513] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 7d61965cf9967510cc3eaf24947bb0ef/family2 of 7d61965cf9967510cc3eaf24947bb0ef into 8eea7783b8184a17975eacc83870ea88(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-20 08:55:47,024 DEBUG [Listener at localhost/43513] regionserver.HRegion(2289): Compaction status journal for 7d61965cf9967510cc3eaf24947bb0ef: 2023-11-20 08:55:47,025 DEBUG [Listener at localhost/43513] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-20 08:55:47,025 DEBUG [Listener at localhost/43513] regionserver.HStore(1912): 37ddd3693eda6c49fa96f6147c47a803/family1 is initiating major compaction (all files) 2023-11-20 08:55:47,025 INFO [Listener at localhost/43513] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-20 08:55:47,025 INFO [Listener at localhost/43513] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-20 08:55:47,025 INFO [Listener at localhost/43513] regionserver.HRegion(2259): Starting compaction of 37ddd3693eda6c49fa96f6147c47a803/family1 in ns:testMinorCompaction,,1700470533458.37ddd3693eda6c49fa96f6147c47a803. 2023-11-20 08:55:47,025 INFO [Listener at localhost/43513] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/family1/3366b2be2edd432c8217b46a323fc446, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/family1/874b1a5edac440bd9960195776417fcb, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/family1/3b2b098619e748498668c98b516e1c3a, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/family1/ede512f2f8ec41c9801f9d3ba3e9cefb, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/family1/e68e4e0692db4eaca83ffdb435461f6d] into tmpdir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/.tmp, totalSize=26.6 K 2023-11-20 08:55:47,025 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting 3366b2be2edd432c8217b46a323fc446, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700470535572 2023-11-20 08:55:47,026 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting 874b1a5edac440bd9960195776417fcb, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700470537358 2023-11-20 08:55:47,026 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/family2/c3e606e20b044e63b397fcdfc41fe050, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/family2/f8fc696b6bc947a4a2cc0eaf068eee9f, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/family2/b31e2bd3abc54feebe49fd970fa6c643, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/family2/8835f68a6c334517b9f2895ed2248d58, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/family2/14f0ee445bbb413fafa866fa21e5ad13] to archive 2023-11-20 08:55:47,026 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting 3b2b098619e748498668c98b516e1c3a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700470539149 2023-11-20 08:55:47,027 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:55:47,027 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting ede512f2f8ec41c9801f9d3ba3e9cefb, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700470540946 2023-11-20 08:55:47,027 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting e68e4e0692db4eaca83ffdb435461f6d, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-20 08:55:47,028 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/family2/c3e606e20b044e63b397fcdfc41fe050 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/family2/c3e606e20b044e63b397fcdfc41fe050 2023-11-20 08:55:47,030 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/family2/f8fc696b6bc947a4a2cc0eaf068eee9f to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/family2/f8fc696b6bc947a4a2cc0eaf068eee9f 2023-11-20 08:55:47,031 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/family2/b31e2bd3abc54feebe49fd970fa6c643 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/family2/b31e2bd3abc54feebe49fd970fa6c643 2023-11-20 08:55:47,032 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/family2/8835f68a6c334517b9f2895ed2248d58 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/family2/8835f68a6c334517b9f2895ed2248d58 2023-11-20 08:55:47,033 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/family2/14f0ee445bbb413fafa866fa21e5ad13 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/family2/14f0ee445bbb413fafa866fa21e5ad13 2023-11-20 08:55:47,038 INFO [Listener at localhost/43513] throttle.PressureAwareThroughputController(145): 37ddd3693eda6c49fa96f6147c47a803#family1#compaction#151 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-20 08:55:47,447 INFO [Listener at localhost/43513] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202311200fd4c0e1f9e14588a2b99ad29c31b7ed_del 2023-11-20 08:55:47,447 INFO [Listener at localhost/43513] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311200fd4c0e1f9e14588a2b99ad29c31b7ed_del to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202311200fd4c0e1f9e14588a2b99ad29c31b7ed_del 2023-11-20 08:55:48,261 INFO [Listener at localhost/43513] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 525fe9a6de5b43419bd832329f4d8ad9 2023-11-20 08:55:48,262 DEBUG [Listener at localhost/43513] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/.tmp/family1/525fe9a6de5b43419bd832329f4d8ad9 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/family1/525fe9a6de5b43419bd832329f4d8ad9 2023-11-20 08:55:48,266 INFO [Listener at localhost/43513] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 525fe9a6de5b43419bd832329f4d8ad9 2023-11-20 08:55:48,267 INFO [Listener at localhost/43513] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 37ddd3693eda6c49fa96f6147c47a803/family1 of 37ddd3693eda6c49fa96f6147c47a803 into 525fe9a6de5b43419bd832329f4d8ad9(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-20 08:55:48,267 DEBUG [Listener at localhost/43513] regionserver.HRegion(2289): Compaction status journal for 37ddd3693eda6c49fa96f6147c47a803: 2023-11-20 08:55:48,267 DEBUG [Listener at localhost/43513] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-20 08:55:48,267 DEBUG [Listener at localhost/43513] regionserver.HStore(1912): 37ddd3693eda6c49fa96f6147c47a803/family2 is initiating major compaction (all files) 2023-11-20 08:55:48,267 INFO [Listener at localhost/43513] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-20 08:55:48,267 INFO [Listener at localhost/43513] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-20 08:55:48,268 INFO [Listener at localhost/43513] regionserver.HRegion(2259): Starting compaction of 37ddd3693eda6c49fa96f6147c47a803/family2 in ns:testMinorCompaction,,1700470533458.37ddd3693eda6c49fa96f6147c47a803. 2023-11-20 08:55:48,268 INFO [Listener at localhost/43513] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/family2/d40192cade8246a7b9590240c9f0ce96, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/family2/0855f07d404440a7b43d660f79875386, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/family2/7264b9257c08456da42bfe3a81c237ee, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/family2/4d5242e17dfb437dbfbe35c55cd51b6c, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/family2/81a868e2b57e450c8694f9ac389965dc] into tmpdir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/.tmp, totalSize=25.3 K 2023-11-20 08:55:48,269 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting d40192cade8246a7b9590240c9f0ce96, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700470535572 2023-11-20 08:55:48,269 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting 0855f07d404440a7b43d660f79875386, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700470537358 2023-11-20 08:55:48,270 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting 7264b9257c08456da42bfe3a81c237ee, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700470539149 2023-11-20 08:55:48,270 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting 4d5242e17dfb437dbfbe35c55cd51b6c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700470540946 2023-11-20 08:55:48,270 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting 81a868e2b57e450c8694f9ac389965dc, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-20 08:55:48,278 INFO [Listener at localhost/43513] throttle.PressureAwareThroughputController(145): 37ddd3693eda6c49fa96f6147c47a803#family2#compaction#152 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-20 08:55:48,327 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/family1/3366b2be2edd432c8217b46a323fc446, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/family1/874b1a5edac440bd9960195776417fcb, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/family1/3b2b098619e748498668c98b516e1c3a, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/family1/ede512f2f8ec41c9801f9d3ba3e9cefb, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/family1/e68e4e0692db4eaca83ffdb435461f6d] to archive 2023-11-20 08:55:48,328 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:55:48,329 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/family1/3366b2be2edd432c8217b46a323fc446 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/family1/3366b2be2edd432c8217b46a323fc446 2023-11-20 08:55:48,330 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/family1/874b1a5edac440bd9960195776417fcb to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/family1/874b1a5edac440bd9960195776417fcb 2023-11-20 08:55:48,331 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/family1/3b2b098619e748498668c98b516e1c3a to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/family1/3b2b098619e748498668c98b516e1c3a 2023-11-20 08:55:48,332 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/family1/ede512f2f8ec41c9801f9d3ba3e9cefb to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/family1/ede512f2f8ec41c9801f9d3ba3e9cefb 2023-11-20 08:55:48,333 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/family1/e68e4e0692db4eaca83ffdb435461f6d to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/family1/e68e4e0692db4eaca83ffdb435461f6d 2023-11-20 08:55:48,690 INFO [Listener at localhost/43513] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231120942ecff486bc4d50a7378189d875cf26_del 2023-11-20 08:55:48,690 INFO [Listener at localhost/43513] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231120942ecff486bc4d50a7378189d875cf26_del to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231120942ecff486bc4d50a7378189d875cf26_del 2023-11-20 08:55:49,107 INFO [Listener at localhost/43513] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6c29b8c35a5744cdae99b26de68bbfb8 2023-11-20 08:55:49,108 DEBUG [Listener at localhost/43513] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/.tmp/family2/6c29b8c35a5744cdae99b26de68bbfb8 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/family2/6c29b8c35a5744cdae99b26de68bbfb8 2023-11-20 08:55:49,111 INFO [Listener at localhost/43513] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6c29b8c35a5744cdae99b26de68bbfb8 2023-11-20 08:55:49,112 INFO [Listener at localhost/43513] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 37ddd3693eda6c49fa96f6147c47a803/family2 of 37ddd3693eda6c49fa96f6147c47a803 into 6c29b8c35a5744cdae99b26de68bbfb8(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-20 08:55:49,112 DEBUG [Listener at localhost/43513] regionserver.HRegion(2289): Compaction status journal for 37ddd3693eda6c49fa96f6147c47a803: 2023-11-20 08:55:49,112 DEBUG [Listener at localhost/43513] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-20 08:55:49,112 DEBUG [Listener at localhost/43513] regionserver.HStore(1912): a4223368d0abcd3a665a863e674f7fce/family1 is initiating major compaction (all files) 2023-11-20 08:55:49,112 INFO [Listener at localhost/43513] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-20 08:55:49,112 INFO [Listener at localhost/43513] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-20 08:55:49,112 INFO [Listener at localhost/43513] regionserver.HRegion(2259): Starting compaction of a4223368d0abcd3a665a863e674f7fce/family1 in ns:testMinorCompaction,2,1700470533458.a4223368d0abcd3a665a863e674f7fce. 2023-11-20 08:55:49,112 INFO [Listener at localhost/43513] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/family1/d50ee8413982412599cbdd6b17520fd4, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/family1/dba09dbf1ace4ed186598255b3ee61e2, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/family1/3e9113abdcbc4f84a2e7e7b0a3240db8, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/family1/2dee5034f0114339a1f0f26cb9eebfbd, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/family1/00dacb7e0dbd4b0ab3c478c8a7779cb6] into tmpdir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/.tmp, totalSize=26.6 K 2023-11-20 08:55:49,113 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting d50ee8413982412599cbdd6b17520fd4, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700470535572 2023-11-20 08:55:49,113 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting dba09dbf1ace4ed186598255b3ee61e2, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700470537358 2023-11-20 08:55:49,113 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting 3e9113abdcbc4f84a2e7e7b0a3240db8, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700470539149 2023-11-20 08:55:49,114 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting 2dee5034f0114339a1f0f26cb9eebfbd, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700470540946 2023-11-20 08:55:49,114 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting 00dacb7e0dbd4b0ab3c478c8a7779cb6, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-20 08:55:49,122 INFO [Listener at localhost/43513] throttle.PressureAwareThroughputController(145): a4223368d0abcd3a665a863e674f7fce#family1#compaction#153 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-20 08:55:49,126 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/family2/d40192cade8246a7b9590240c9f0ce96, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/family2/0855f07d404440a7b43d660f79875386, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/family2/7264b9257c08456da42bfe3a81c237ee, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/family2/4d5242e17dfb437dbfbe35c55cd51b6c, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/family2/81a868e2b57e450c8694f9ac389965dc] to archive 2023-11-20 08:55:49,127 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:55:49,129 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/family2/d40192cade8246a7b9590240c9f0ce96 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/family2/d40192cade8246a7b9590240c9f0ce96 2023-11-20 08:55:49,131 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/family2/0855f07d404440a7b43d660f79875386 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/family2/0855f07d404440a7b43d660f79875386 2023-11-20 08:55:49,132 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/family2/7264b9257c08456da42bfe3a81c237ee to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/family2/7264b9257c08456da42bfe3a81c237ee 2023-11-20 08:55:49,132 INFO [Listener at localhost/43513] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023112046bc97cb996b4818b20be7aa5796d010_del 2023-11-20 08:55:49,133 INFO [Listener at localhost/43513] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023112046bc97cb996b4818b20be7aa5796d010_del to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023112046bc97cb996b4818b20be7aa5796d010_del 2023-11-20 08:55:49,134 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/family2/4d5242e17dfb437dbfbe35c55cd51b6c to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/family2/4d5242e17dfb437dbfbe35c55cd51b6c 2023-11-20 08:55:49,141 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/family2/81a868e2b57e450c8694f9ac389965dc to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/family2/81a868e2b57e450c8694f9ac389965dc 2023-11-20 08:55:49,950 INFO [Listener at localhost/43513] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e7ea2ce1031042f0b78f057ec6a4dff8 2023-11-20 08:55:49,951 DEBUG [Listener at localhost/43513] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/.tmp/family1/e7ea2ce1031042f0b78f057ec6a4dff8 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/family1/e7ea2ce1031042f0b78f057ec6a4dff8 2023-11-20 08:55:49,955 INFO [Listener at localhost/43513] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e7ea2ce1031042f0b78f057ec6a4dff8 2023-11-20 08:55:49,955 INFO [Listener at localhost/43513] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in a4223368d0abcd3a665a863e674f7fce/family1 of a4223368d0abcd3a665a863e674f7fce into e7ea2ce1031042f0b78f057ec6a4dff8(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-20 08:55:49,956 DEBUG [Listener at localhost/43513] regionserver.HRegion(2289): Compaction status journal for a4223368d0abcd3a665a863e674f7fce: 2023-11-20 08:55:49,956 DEBUG [Listener at localhost/43513] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-20 08:55:49,956 DEBUG [Listener at localhost/43513] regionserver.HStore(1912): a4223368d0abcd3a665a863e674f7fce/family2 is initiating major compaction (all files) 2023-11-20 08:55:49,956 INFO [Listener at localhost/43513] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-20 08:55:49,956 INFO [Listener at localhost/43513] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-20 08:55:49,956 INFO [Listener at localhost/43513] regionserver.HRegion(2259): Starting compaction of a4223368d0abcd3a665a863e674f7fce/family2 in ns:testMinorCompaction,2,1700470533458.a4223368d0abcd3a665a863e674f7fce. 2023-11-20 08:55:49,956 INFO [Listener at localhost/43513] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/family2/c6985c6392cb401a8c9401b160da48b5, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/family2/bf981633222c4f62aee80e0ddb8a86bd, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/family2/44c5112a22284eb7a229a3437e2ed6a5, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/family2/833d47799c96449cbd893c5d55535638, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/family2/27b49d28aaf94373b79d26ee4787fd94] into tmpdir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/.tmp, totalSize=25.3 K 2023-11-20 08:55:49,956 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting c6985c6392cb401a8c9401b160da48b5, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700470535572 2023-11-20 08:55:49,957 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting bf981633222c4f62aee80e0ddb8a86bd, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700470537358 2023-11-20 08:55:49,957 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting 44c5112a22284eb7a229a3437e2ed6a5, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700470539149 2023-11-20 08:55:49,957 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting 833d47799c96449cbd893c5d55535638, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700470540946 2023-11-20 08:55:49,958 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting 27b49d28aaf94373b79d26ee4787fd94, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-20 08:55:49,966 INFO [Listener at localhost/43513] throttle.PressureAwareThroughputController(145): a4223368d0abcd3a665a863e674f7fce#family2#compaction#154 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-20 08:55:49,973 INFO [Listener at localhost/43513] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231120840a3b7de1fe4ac285d540cdf2a5a382_del 2023-11-20 08:55:49,974 INFO [Listener at localhost/43513] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231120840a3b7de1fe4ac285d540cdf2a5a382_del to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20231120840a3b7de1fe4ac285d540cdf2a5a382_del 2023-11-20 08:55:50,026 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/family1/d50ee8413982412599cbdd6b17520fd4, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/family1/dba09dbf1ace4ed186598255b3ee61e2, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/family1/3e9113abdcbc4f84a2e7e7b0a3240db8, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/family1/2dee5034f0114339a1f0f26cb9eebfbd, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/family1/00dacb7e0dbd4b0ab3c478c8a7779cb6] to archive 2023-11-20 08:55:50,027 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:55:50,029 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/family1/d50ee8413982412599cbdd6b17520fd4 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/family1/d50ee8413982412599cbdd6b17520fd4 2023-11-20 08:55:50,030 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/family1/dba09dbf1ace4ed186598255b3ee61e2 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/family1/dba09dbf1ace4ed186598255b3ee61e2 2023-11-20 08:55:50,031 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/family1/3e9113abdcbc4f84a2e7e7b0a3240db8 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/family1/3e9113abdcbc4f84a2e7e7b0a3240db8 2023-11-20 08:55:50,032 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/family1/2dee5034f0114339a1f0f26cb9eebfbd to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/family1/2dee5034f0114339a1f0f26cb9eebfbd 2023-11-20 08:55:50,033 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/family1/00dacb7e0dbd4b0ab3c478c8a7779cb6 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/family1/00dacb7e0dbd4b0ab3c478c8a7779cb6 2023-11-20 08:55:50,790 INFO [Listener at localhost/43513] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 22c8299c9508488eb866ce31fefef2dc 2023-11-20 08:55:50,791 DEBUG [Listener at localhost/43513] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/.tmp/family2/22c8299c9508488eb866ce31fefef2dc as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/family2/22c8299c9508488eb866ce31fefef2dc 2023-11-20 08:55:50,796 INFO [Listener at localhost/43513] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 22c8299c9508488eb866ce31fefef2dc 2023-11-20 08:55:50,797 INFO [Listener at localhost/43513] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in a4223368d0abcd3a665a863e674f7fce/family2 of a4223368d0abcd3a665a863e674f7fce into 22c8299c9508488eb866ce31fefef2dc(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-20 08:55:50,797 DEBUG [Listener at localhost/43513] regionserver.HRegion(2289): Compaction status journal for a4223368d0abcd3a665a863e674f7fce: 2023-11-20 08:55:50,801 DEBUG [Listener at localhost/43513] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-20 08:55:50,804 DEBUG [Listener at localhost/43513] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-20 08:55:50,807 DEBUG [Listener at localhost/43513] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-20 08:55:50,808 DEBUG [Listener at localhost/43513] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-20 08:55:50,814 INFO [Listener at localhost/43513] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-20 08:55:50,828 INFO [Listener at localhost/43513] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 3 del files, 3 selected files, and 0 irrelevant files table 'ns:testMinorCompaction' and column 'family1' 2023-11-20 08:55:50,831 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/family2/c6985c6392cb401a8c9401b160da48b5, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/family2/bf981633222c4f62aee80e0ddb8a86bd, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/family2/44c5112a22284eb7a229a3437e2ed6a5, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/family2/833d47799c96449cbd893c5d55535638, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/family2/27b49d28aaf94373b79d26ee4787fd94] to archive 2023-11-20 08:55:50,831 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:55:50,831 INFO [Listener at localhost/43513] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202311200fd4c0e1f9e14588a2b99ad29c31b7ed_del 2023-11-20 08:55:50,833 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/family2/c6985c6392cb401a8c9401b160da48b5 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/family2/c6985c6392cb401a8c9401b160da48b5 2023-11-20 08:55:50,834 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/family2/bf981633222c4f62aee80e0ddb8a86bd to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/family2/bf981633222c4f62aee80e0ddb8a86bd 2023-11-20 08:55:50,835 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/family2/44c5112a22284eb7a229a3437e2ed6a5 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/family2/44c5112a22284eb7a229a3437e2ed6a5 2023-11-20 08:55:50,836 INFO [Listener at localhost/43513] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202311202caa832b0fe6471a95f8f3f8e5bcea10_del 2023-11-20 08:55:50,837 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/family2/833d47799c96449cbd893c5d55535638 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/family2/833d47799c96449cbd893c5d55535638 2023-11-20 08:55:50,838 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/family2/27b49d28aaf94373b79d26ee4787fd94 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/family2/27b49d28aaf94373b79d26ee4787fd94 2023-11-20 08:55:50,839 INFO [Listener at localhost/43513] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023112046bc97cb996b4818b20be7aa5796d010_del 2023-11-20 08:55:50,839 INFO [Listener at localhost/43513] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='ns:testMinorCompaction' column='family1' 2023-11-20 08:55:50,841 DEBUG [Listener at localhost/43513] zookeeper.ReadOnlyZKClient(139): Connect 0x140fb477 to 127.0.0.1:64635 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-20 08:55:50,847 DEBUG [Listener at localhost/43513] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7831663d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-20 08:55:50,848 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231120 for table='ns:testMinorCompaction' and column='family1' 2023-11-20 08:55:50,848 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231120 for table='ns:testMinorCompaction' and column='family1' 2023-11-20 08:55:50,848 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231120 for table='ns:testMinorCompaction' and column='family1' 2023-11-20 08:55:50,889 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311204904743497f64213a6f5e6e004925b66 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202311204904743497f64213a6f5e6e004925b66 2023-11-20 08:55:50,889 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231120 table='ns:testMinorCompaction' column='family1' 2023-11-20 08:55:50,902 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-20 08:55:50,905 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45600, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-20 08:55:50,912 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-20 08:55:50,916 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49584, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-20 08:55:50,931 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231120/family1/b6cf23c9713b46adaeb207c4c8adf6ca first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x01] 2023-11-20 08:55:50,932 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,1,1700470533458.7d61965cf9967510cc3eaf24947bb0ef., hostname=jenkins-hbase4.apache.org,38491,1700470412215, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231120/family1/b6cf23c9713b46adaeb207c4c8adf6ca}] 2023-11-20 08:55:50,938 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38491] regionserver.HStore(763): Validating hfile at hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231120/family1/b6cf23c9713b46adaeb207c4c8adf6ca for inclusion in 7d61965cf9967510cc3eaf24947bb0ef/family1 2023-11-20 08:55:50,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38491] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x01 2023-11-20 08:55:50,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38491] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-20 08:55:50,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38491] regionserver.HRegion(2446): Flush status journal for 7d61965cf9967510cc3eaf24947bb0ef: 2023-11-20 08:55:50,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38491] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231120/family1/b6cf23c9713b46adaeb207c4c8adf6ca to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__ns_testMinorCompaction__31m5kivq7kj05tjvcstdlbslkjv03qbo1l3k273rgqofg1htqt9dlc1nni2r7e9r/family1/b6cf23c9713b46adaeb207c4c8adf6ca 2023-11-20 08:55:50,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38491] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__ns_testMinorCompaction__31m5kivq7kj05tjvcstdlbslkjv03qbo1l3k273rgqofg1htqt9dlc1nni2r7e9r/family1/b6cf23c9713b46adaeb207c4c8adf6ca as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/family1/5d3f88f29ec74007af8af6f9b9c73b03_SeqId_28_ 2023-11-20 08:55:50,944 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38491] regionserver.HStore(849): Loaded HFile hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__ns_testMinorCompaction__31m5kivq7kj05tjvcstdlbslkjv03qbo1l3k273rgqofg1htqt9dlc1nni2r7e9r/family1/b6cf23c9713b46adaeb207c4c8adf6ca into 7d61965cf9967510cc3eaf24947bb0ef/family1 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/family1/5d3f88f29ec74007af8af6f9b9c73b03_SeqId_28_ - updating store file list. 2023-11-20 08:55:50,948 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38491] regionserver.HStore(882): Loaded HFile hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/family1/5d3f88f29ec74007af8af6f9b9c73b03_SeqId_28_ into 7d61965cf9967510cc3eaf24947bb0ef/family1 2023-11-20 08:55:50,948 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38491] regionserver.HStore(855): Successfully loaded hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__ns_testMinorCompaction__31m5kivq7kj05tjvcstdlbslkjv03qbo1l3k273rgqofg1htqt9dlc1nni2r7e9r/family1/b6cf23c9713b46adaeb207c4c8adf6ca into 7d61965cf9967510cc3eaf24947bb0ef/family1 (new location: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/family1/5d3f88f29ec74007af8af6f9b9c73b03_SeqId_28_) 2023-11-20 08:55:50,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38491] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__ns_testMinorCompaction__31m5kivq7kj05tjvcstdlbslkjv03qbo1l3k273rgqofg1htqt9dlc1nni2r7e9r/family1/b6cf23c9713b46adaeb207c4c8adf6ca 2023-11-20 08:55:50,950 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231120 table='ns:testMinorCompaction' column='family1' 2023-11-20 08:55:50,951 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:55:50,952 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202311207d06e1baf2e34d009074ed2e8abf6026 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202311207d06e1baf2e34d009074ed2e8abf6026 2023-11-20 08:55:50,952 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-11-20 08:55:50,952 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231120' 2023-11-20 08:55:50,953 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231120 for table='ns:testMinorCompaction' and column='family1' 2023-11-20 08:55:51,680 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231120b5d8c2ef70e54abfa0509b3e320ff5d4 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231120b5d8c2ef70e54abfa0509b3e320ff5d4 2023-11-20 08:55:51,680 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231120 table='ns:testMinorCompaction' column='family1' 2023-11-20 08:55:51,685 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231120a3058a07a4ff4e6b8f333827982bb741 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231120a3058a07a4ff4e6b8f333827982bb741 2023-11-20 08:55:51,686 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231120 table='ns:testMinorCompaction' column='family1' 2023-11-20 08:55:51,704 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231120/family1/55f9ee1d48ab4b00923ce258a9974471 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x01] 2023-11-20 08:55:51,704 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,2,1700470533458.a4223368d0abcd3a665a863e674f7fce., hostname=jenkins-hbase4.apache.org,38491,1700470412215, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231120/family1/55f9ee1d48ab4b00923ce258a9974471}] 2023-11-20 08:55:51,706 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38491] regionserver.HStore(763): Validating hfile at hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231120/family1/55f9ee1d48ab4b00923ce258a9974471 for inclusion in a4223368d0abcd3a665a863e674f7fce/family1 2023-11-20 08:55:51,709 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231120/family1/6e7de79ae29f41b9a790aabdc785e620 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x01] 2023-11-20 08:55:51,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38491] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x01 2023-11-20 08:55:51,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38491] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-20 08:55:51,710 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,,1700470533458.37ddd3693eda6c49fa96f6147c47a803., hostname=jenkins-hbase4.apache.org,38491,1700470412215, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231120/family1/6e7de79ae29f41b9a790aabdc785e620}] 2023-11-20 08:55:51,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38491] regionserver.HRegion(2446): Flush status journal for a4223368d0abcd3a665a863e674f7fce: 2023-11-20 08:55:51,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38491] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231120/family1/55f9ee1d48ab4b00923ce258a9974471 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__ns_testMinorCompaction__naf3fjrp7lc8bkvhl636a3dnn7llaujb3cvqleoc00e71srmfocalarmpl7o3fis/family1/55f9ee1d48ab4b00923ce258a9974471 2023-11-20 08:55:51,711 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HStore(763): Validating hfile at hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231120/family1/6e7de79ae29f41b9a790aabdc785e620 for inclusion in 37ddd3693eda6c49fa96f6147c47a803/family1 2023-11-20 08:55:51,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38491] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__ns_testMinorCompaction__naf3fjrp7lc8bkvhl636a3dnn7llaujb3cvqleoc00e71srmfocalarmpl7o3fis/family1/55f9ee1d48ab4b00923ce258a9974471 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/family1/87aeade0920c4e339c45e9eecb3901da_SeqId_28_ 2023-11-20 08:55:51,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x01 2023-11-20 08:55:51,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HStore(777): Region bounds: first= last=1 2023-11-20 08:55:51,714 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38491] regionserver.HStore(849): Loaded HFile hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__ns_testMinorCompaction__naf3fjrp7lc8bkvhl636a3dnn7llaujb3cvqleoc00e71srmfocalarmpl7o3fis/family1/55f9ee1d48ab4b00923ce258a9974471 into a4223368d0abcd3a665a863e674f7fce/family1 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/family1/87aeade0920c4e339c45e9eecb3901da_SeqId_28_ - updating store file list. 2023-11-20 08:55:51,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HRegion(2446): Flush status journal for 37ddd3693eda6c49fa96f6147c47a803: 2023-11-20 08:55:51,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231120/family1/6e7de79ae29f41b9a790aabdc785e620 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__ns_testMinorCompaction__niklji2cglqqap6fjp4ld8a8j7p2rudqusv0b7f138ck57k420o3lm2cp6csfqsi/family1/6e7de79ae29f41b9a790aabdc785e620 2023-11-20 08:55:51,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__ns_testMinorCompaction__niklji2cglqqap6fjp4ld8a8j7p2rudqusv0b7f138ck57k420o3lm2cp6csfqsi/family1/6e7de79ae29f41b9a790aabdc785e620 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/family1/bf74c624ea18436386ae0edd885ff9b7_SeqId_28_ 2023-11-20 08:55:51,717 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HStore(849): Loaded HFile hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__ns_testMinorCompaction__niklji2cglqqap6fjp4ld8a8j7p2rudqusv0b7f138ck57k420o3lm2cp6csfqsi/family1/6e7de79ae29f41b9a790aabdc785e620 into 37ddd3693eda6c49fa96f6147c47a803/family1 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/family1/bf74c624ea18436386ae0edd885ff9b7_SeqId_28_ - updating store file list. 2023-11-20 08:55:51,718 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38491] regionserver.HStore(882): Loaded HFile hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/family1/87aeade0920c4e339c45e9eecb3901da_SeqId_28_ into a4223368d0abcd3a665a863e674f7fce/family1 2023-11-20 08:55:51,718 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38491] regionserver.HStore(855): Successfully loaded hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__ns_testMinorCompaction__naf3fjrp7lc8bkvhl636a3dnn7llaujb3cvqleoc00e71srmfocalarmpl7o3fis/family1/55f9ee1d48ab4b00923ce258a9974471 into a4223368d0abcd3a665a863e674f7fce/family1 (new location: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/family1/87aeade0920c4e339c45e9eecb3901da_SeqId_28_) 2023-11-20 08:55:51,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=38491] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__ns_testMinorCompaction__naf3fjrp7lc8bkvhl636a3dnn7llaujb3cvqleoc00e71srmfocalarmpl7o3fis/family1/55f9ee1d48ab4b00923ce258a9974471 2023-11-20 08:55:51,720 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231120 table='ns:testMinorCompaction' column='family1' 2023-11-20 08:55:51,721 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:55:51,721 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HStore(882): Loaded HFile hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/family1/bf74c624ea18436386ae0edd885ff9b7_SeqId_28_ into 37ddd3693eda6c49fa96f6147c47a803/family1 2023-11-20 08:55:51,721 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HStore(855): Successfully loaded hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__ns_testMinorCompaction__niklji2cglqqap6fjp4ld8a8j7p2rudqusv0b7f138ck57k420o3lm2cp6csfqsi/family1/6e7de79ae29f41b9a790aabdc785e620 into 37ddd3693eda6c49fa96f6147c47a803/family1 (new location: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/family1/bf74c624ea18436386ae0edd885ff9b7_SeqId_28_) 2023-11-20 08:55:51,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__ns_testMinorCompaction__niklji2cglqqap6fjp4ld8a8j7p2rudqusv0b7f138ck57k420o3lm2cp6csfqsi/family1/6e7de79ae29f41b9a790aabdc785e620 2023-11-20 08:55:51,723 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023112039faf3037ad14b9996864085d5013919 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023112039faf3037ad14b9996864085d5013919 2023-11-20 08:55:51,723 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-11-20 08:55:51,723 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231120' 2023-11-20 08:55:51,723 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231120 for table='ns:testMinorCompaction' and column='family1' 2023-11-20 08:55:51,723 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231120 table='ns:testMinorCompaction' column='family1' 2023-11-20 08:55:51,724 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:55:51,725 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023112079043a0aedeb4c12afb97d4dd362c16e to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023112079043a0aedeb4c12afb97d4dd362c16e 2023-11-20 08:55:51,725 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-11-20 08:55:51,725 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231120' 2023-11-20 08:55:51,726 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231120 for table='ns:testMinorCompaction' and column='family1' 2023-11-20 08:55:51,726 INFO [Listener at localhost/43513] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='ns:testMinorCompaction' column='family1' 2023-11-20 08:55:51,728 DEBUG [Listener at localhost/43513] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-20 08:55:51,730 DEBUG [Listener at localhost/43513] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-20 08:55:51,733 DEBUG [Listener at localhost/43513] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-20 08:55:51,733 DEBUG [Listener at localhost/43513] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-20 08:55:51,753 INFO [Listener at localhost/43513] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompaction Thread=251 (was 289), OpenFileDescriptor=649 (was 786), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=111 (was 115), ProcessCount=168 (was 168), AvailableMemoryMB=15099 (was 15005) - AvailableMemoryMB LEAK? - 2023-11-20 08:55:51,765 INFO [Listener at localhost/43513] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=251, OpenFileDescriptor=649, MaxFileDescriptor=60000, SystemLoadAverage=111, ProcessCount=168, AvailableMemoryMB=15098 2023-11-20 08:55:51,767 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-20 08:55:51,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:51,769 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-20 08:55:51,769 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithMonthlyPolicy" procId is: 112 2023-11-20 08:55:51,769 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-20 08:55:51,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-20 08:55:51,770 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec 2023-11-20 08:55:51,771 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec empty. 2023-11-20 08:55:51,771 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec 2023-11-20 08:55:51,771 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithMonthlyPolicy regions 2023-11-20 08:55:51,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-20 08:55:52,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-20 08:55:52,178 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-20 08:55:52,179 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => ca958e54adf0d4e15cf293b5a4212aec, NAME => 'testMinorCompactionWithMonthlyPolicy,,1700470551767.ca958e54adf0d4e15cf293b5a4212aec.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp 2023-11-20 08:55:52,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-20 08:55:52,584 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1700470551767.ca958e54adf0d4e15cf293b5a4212aec.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-20 08:55:52,584 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing ca958e54adf0d4e15cf293b5a4212aec, disabling compactions & flushes 2023-11-20 08:55:52,585 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1700470551767.ca958e54adf0d4e15cf293b5a4212aec. 2023-11-20 08:55:52,585 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1700470551767.ca958e54adf0d4e15cf293b5a4212aec. 2023-11-20 08:55:52,585 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1700470551767.ca958e54adf0d4e15cf293b5a4212aec. after waiting 0 ms 2023-11-20 08:55:52,585 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1700470551767.ca958e54adf0d4e15cf293b5a4212aec. 2023-11-20 08:55:52,585 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1700470551767.ca958e54adf0d4e15cf293b5a4212aec. 2023-11-20 08:55:52,585 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for ca958e54adf0d4e15cf293b5a4212aec: 2023-11-20 08:55:52,587 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-20 08:55:52,588 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithMonthlyPolicy,,1700470551767.ca958e54adf0d4e15cf293b5a4212aec.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1700470552588"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700470552588"}]},"ts":"1700470552588"} 2023-11-20 08:55:52,589 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-20 08:55:52,590 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-20 08:55:52,590 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700470552590"}]},"ts":"1700470552590"} 2023-11-20 08:55:52,591 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-11-20 08:55:52,594 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=ca958e54adf0d4e15cf293b5a4212aec, ASSIGN}] 2023-11-20 08:55:52,596 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=ca958e54adf0d4e15cf293b5a4212aec, ASSIGN 2023-11-20 08:55:52,596 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=ca958e54adf0d4e15cf293b5a4212aec, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38491,1700470412215; forceNewPlan=false, retain=false 2023-11-20 08:55:52,747 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=ca958e54adf0d4e15cf293b5a4212aec, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:52,748 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithMonthlyPolicy,,1700470551767.ca958e54adf0d4e15cf293b5a4212aec.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1700470552747"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700470552747"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700470552747"}]},"ts":"1700470552747"} 2023-11-20 08:55:52,749 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=114, ppid=113, state=RUNNABLE; OpenRegionProcedure ca958e54adf0d4e15cf293b5a4212aec, server=jenkins-hbase4.apache.org,38491,1700470412215}] 2023-11-20 08:55:52,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-20 08:55:52,901 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:52,903 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMinorCompactionWithMonthlyPolicy,,1700470551767.ca958e54adf0d4e15cf293b5a4212aec. 2023-11-20 08:55:52,903 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ca958e54adf0d4e15cf293b5a4212aec, NAME => 'testMinorCompactionWithMonthlyPolicy,,1700470551767.ca958e54adf0d4e15cf293b5a4212aec.', STARTKEY => '', ENDKEY => ''} 2023-11-20 08:55:52,903 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithMonthlyPolicy ca958e54adf0d4e15cf293b5a4212aec 2023-11-20 08:55:52,904 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1700470551767.ca958e54adf0d4e15cf293b5a4212aec.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-20 08:55:52,904 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ca958e54adf0d4e15cf293b5a4212aec 2023-11-20 08:55:52,904 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ca958e54adf0d4e15cf293b5a4212aec 2023-11-20 08:55:52,905 INFO [StoreOpener-ca958e54adf0d4e15cf293b5a4212aec-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region ca958e54adf0d4e15cf293b5a4212aec 2023-11-20 08:55:52,906 DEBUG [StoreOpener-ca958e54adf0d4e15cf293b5a4212aec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1 2023-11-20 08:55:52,906 DEBUG [StoreOpener-ca958e54adf0d4e15cf293b5a4212aec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1 2023-11-20 08:55:52,906 INFO [StoreOpener-ca958e54adf0d4e15cf293b5a4212aec-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ca958e54adf0d4e15cf293b5a4212aec columnFamilyName family1 2023-11-20 08:55:52,908 INFO [StoreOpener-ca958e54adf0d4e15cf293b5a4212aec-1] regionserver.HStore(310): Store=ca958e54adf0d4e15cf293b5a4212aec/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-20 08:55:52,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec 2023-11-20 08:55:52,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec 2023-11-20 08:55:52,911 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ca958e54adf0d4e15cf293b5a4212aec 2023-11-20 08:55:52,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-20 08:55:52,913 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ca958e54adf0d4e15cf293b5a4212aec; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69332680, jitterRate=0.03313744068145752}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-20 08:55:52,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ca958e54adf0d4e15cf293b5a4212aec: 2023-11-20 08:55:52,913 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMinorCompactionWithMonthlyPolicy,,1700470551767.ca958e54adf0d4e15cf293b5a4212aec., pid=114, masterSystemTime=1700470552901 2023-11-20 08:55:52,915 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMinorCompactionWithMonthlyPolicy,,1700470551767.ca958e54adf0d4e15cf293b5a4212aec. 2023-11-20 08:55:52,915 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMinorCompactionWithMonthlyPolicy,,1700470551767.ca958e54adf0d4e15cf293b5a4212aec. 2023-11-20 08:55:52,915 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=ca958e54adf0d4e15cf293b5a4212aec, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:52,915 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithMonthlyPolicy,,1700470551767.ca958e54adf0d4e15cf293b5a4212aec.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1700470552915"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700470552915"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700470552915"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700470552915"}]},"ts":"1700470552915"} 2023-11-20 08:55:52,917 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=114, resume processing ppid=113 2023-11-20 08:55:52,917 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=114, ppid=113, state=SUCCESS; OpenRegionProcedure ca958e54adf0d4e15cf293b5a4212aec, server=jenkins-hbase4.apache.org,38491,1700470412215 in 167 msec 2023-11-20 08:55:52,919 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=113, resume processing ppid=112 2023-11-20 08:55:52,919 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=113, ppid=112, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=ca958e54adf0d4e15cf293b5a4212aec, ASSIGN in 323 msec 2023-11-20 08:55:52,919 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-20 08:55:52,919 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700470552919"}]},"ts":"1700470552919"} 2023-11-20 08:55:52,920 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-11-20 08:55:52,922 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-20 08:55:52,923 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy in 1.1550 sec 2023-11-20 08:55:53,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-20 08:55:53,875 INFO [Listener at localhost/43513] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithMonthlyPolicy, procId: 112 completed 2023-11-20 08:55:53,897 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:55:53,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:53,899 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-20 08:55:53,899 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:55:53,899 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-20 08:55:53,899 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-20 08:55:53,899 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:53,899 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:53,901 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:55:53,901 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:53,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:55:53,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:55:53,901 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:53,901 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:55:53,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:53,902 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:53,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:55:53,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:53,902 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:53,902 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:53,902 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-20 08:55:53,902 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:55:53,903 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-20 08:55:53,907 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-20 08:55:53,907 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:55:53,907 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700470551767.ca958e54adf0d4e15cf293b5a4212aec. 2023-11-20 08:55:53,907 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700470551767.ca958e54adf0d4e15cf293b5a4212aec. started... 2023-11-20 08:55:53,908 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ca958e54adf0d4e15cf293b5a4212aec 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-20 08:55:54,335 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511306a00cb65fe2e4fe2860919735870cd7f to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511306a00cb65fe2e4fe2860919735870cd7f 2023-11-20 08:55:54,739 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/.tmp/family1/413f36a1948048c6aa8cce4cfa9a9939 2023-11-20 08:55:54,743 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/.tmp/family1/413f36a1948048c6aa8cce4cfa9a9939 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/413f36a1948048c6aa8cce4cfa9a9939 2023-11-20 08:55:54,746 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/413f36a1948048c6aa8cce4cfa9a9939, entries=1000, sequenceid=5, filesize=166.0 K 2023-11-20 08:55:54,746 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for ca958e54adf0d4e15cf293b5a4212aec in 838ms, sequenceid=5, compaction requested=false 2023-11-20 08:55:54,747 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithMonthlyPolicy' 2023-11-20 08:55:54,747 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ca958e54adf0d4e15cf293b5a4212aec: 2023-11-20 08:55:54,747 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700470551767.ca958e54adf0d4e15cf293b5a4212aec. 2023-11-20 08:55:54,747 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-20 08:55:54,747 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-20 08:55:54,747 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:54,747 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-20 08:55:54,747 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-20 08:55:54,752 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:54,752 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:54,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:54,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:55:54,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:55:54,752 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:54,752 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:55:54,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:55:54,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:55:54,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:54,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:54,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:55:54,754 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-20 08:55:54,754 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@71f85300[Count = 0] remaining members to acquire global barrier 2023-11-20 08:55:54,754 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-20 08:55:54,754 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:54,756 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:54,756 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:54,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:54,756 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-20 08:55:54,756 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-20 08:55:54,756 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:55:54,756 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:54,756 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:55:54,758 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-20 08:55:54,758 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:54,758 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:55:54,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:54,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:55:54,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:55:54,758 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-20 08:55:54,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:55:54,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:55:54,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:54,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:54,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:55:54,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:54,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:54,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:55:54,761 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-20 08:55:54,761 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-20 08:55:54,761 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:55:54,761 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:55:54,761 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:54,761 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:55:54,763 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:54,763 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:54,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:54,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:54,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:55:54,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:55:54,763 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:55:54,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:54,763 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:54,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:55:54,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:55:54,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:55:54,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:54,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:54,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:55:54,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:54,765 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:54,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:54,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:55:54,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:54,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:54,767 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:54,767 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:54,767 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:55:54,767 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:55:54,767 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:54,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:55:54,767 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-20 08:55:54,767 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:55:54,767 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-20 08:55:54,767 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:55:54,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:55:54,767 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:54,768 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:54,768 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:54,768 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:54,768 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-20 08:55:54,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:55:54,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:55:54,768 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:55:54,868 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:55:54,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:55:54,873 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:55:54,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-20 08:55:54,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:54,874 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-20 08:55:54,874 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:55:54,874 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-20 08:55:54,874 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-20 08:55:54,875 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:54,875 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:54,878 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:54,878 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:55:54,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:55:54,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:55:54,878 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:54,878 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:55:54,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:54,878 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:54,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:55:54,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:54,879 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:54,879 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-20 08:55:54,879 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:54,879 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-20 08:55:54,879 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:55:54,879 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-20 08:55:54,879 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-20 08:55:54,880 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:55:54,880 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700470551767.ca958e54adf0d4e15cf293b5a4212aec. 2023-11-20 08:55:54,880 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700470551767.ca958e54adf0d4e15cf293b5a4212aec. started... 2023-11-20 08:55:54,880 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ca958e54adf0d4e15cf293b5a4212aec 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-20 08:55:55,291 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128dfe6d62197ff41e39887ae73dcf4539e to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128dfe6d62197ff41e39887ae73dcf4539e 2023-11-20 08:55:55,295 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/.tmp/family1/2e8a3e5f0764454290bae5cff3edb2be 2023-11-20 08:55:55,298 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/.tmp/family1/2e8a3e5f0764454290bae5cff3edb2be as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/2e8a3e5f0764454290bae5cff3edb2be 2023-11-20 08:55:55,301 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/2e8a3e5f0764454290bae5cff3edb2be, entries=1, sequenceid=9, filesize=5.0 K 2023-11-20 08:55:55,302 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for ca958e54adf0d4e15cf293b5a4212aec in 422ms, sequenceid=9, compaction requested=false 2023-11-20 08:55:55,303 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ca958e54adf0d4e15cf293b5a4212aec: 2023-11-20 08:55:55,303 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700470551767.ca958e54adf0d4e15cf293b5a4212aec. 2023-11-20 08:55:55,303 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-20 08:55:55,303 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-20 08:55:55,303 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:55,303 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-20 08:55:55,303 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-20 08:55:55,305 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:55,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:55,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:55:55,305 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:55,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:55:55,305 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:55,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:55:55,305 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:55:55,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:55:55,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:55,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:55,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:55:55,306 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-20 08:55:55,307 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@898a42[Count = 0] remaining members to acquire global barrier 2023-11-20 08:55:55,307 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-20 08:55:55,307 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:55,308 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:55,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:55,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:55,308 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-20 08:55:55,308 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-20 08:55:55,308 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:55:55,308 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:55,308 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:55:55,309 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-20 08:55:55,309 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:55:55,309 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:55,309 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-20 08:55:55,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:55,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:55:55,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:55:55,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:55:55,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:55:55,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:55,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:55,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:55:55,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:55,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:55,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:55:55,312 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-20 08:55:55,312 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-20 08:55:55,312 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:55:55,312 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:55:55,312 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:55,312 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:55:55,315 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:55,315 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:55,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:55,315 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:55:55,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:55,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:55:55,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:55:55,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:55,316 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:55,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:55:55,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:55:55,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:55:55,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:55,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:55,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:55:55,317 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:55,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:55,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:55,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:55:55,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:55,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:55,319 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:55,319 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:55,319 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:55:55,319 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:55,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:55:55,320 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:55:55,320 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-20 08:55:55,320 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:55:55,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:55:55,320 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:55,320 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:55,320 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-20 08:55:55,319 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:55:55,320 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:55,320 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-20 08:55:55,320 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:55:55,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:55:55,320 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:55,320 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:55:55,420 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:55:55,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:55:55,425 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:55:55,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-20 08:55:55,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:55,426 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-20 08:55:55,426 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:55:55,426 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-20 08:55:55,426 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-20 08:55:55,427 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:55,427 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:55,428 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:55,428 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:55:55,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:55:55,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:55:55,429 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:55,429 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:55:55,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:55,429 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:55,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:55:55,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:55,429 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:55,429 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-20 08:55:55,430 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:55,430 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-20 08:55:55,430 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:55:55,430 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-20 08:55:55,430 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-20 08:55:55,430 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:55:55,430 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700470551767.ca958e54adf0d4e15cf293b5a4212aec. 2023-11-20 08:55:55,430 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700470551767.ca958e54adf0d4e15cf293b5a4212aec. started... 2023-11-20 08:55:55,430 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ca958e54adf0d4e15cf293b5a4212aec 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-20 08:55:55,840 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201378c35e5682c4e5ba5c7ea1227019812 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151201378c35e5682c4e5ba5c7ea1227019812 2023-11-20 08:55:56,245 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/.tmp/family1/1c04ac6ebf264ab09eb3d47c2352ac82 2023-11-20 08:55:56,249 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/.tmp/family1/1c04ac6ebf264ab09eb3d47c2352ac82 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/1c04ac6ebf264ab09eb3d47c2352ac82 2023-11-20 08:55:56,252 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/1c04ac6ebf264ab09eb3d47c2352ac82, entries=1, sequenceid=13, filesize=4.9 K 2023-11-20 08:55:56,253 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ca958e54adf0d4e15cf293b5a4212aec in 823ms, sequenceid=13, compaction requested=true 2023-11-20 08:55:56,253 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ca958e54adf0d4e15cf293b5a4212aec: 2023-11-20 08:55:56,253 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700470551767.ca958e54adf0d4e15cf293b5a4212aec. 2023-11-20 08:55:56,253 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-20 08:55:56,253 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-20 08:55:56,253 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:56,253 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-20 08:55:56,253 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-20 08:55:56,254 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:56,255 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:56,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:56,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:55:56,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:55:56,255 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:56,255 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:55:56,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:55:56,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:55:56,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:56,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:56,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:55:56,256 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-20 08:55:56,256 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9f00125[Count = 0] remaining members to acquire global barrier 2023-11-20 08:55:56,256 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-20 08:55:56,256 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:56,259 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:56,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:56,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:56,259 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-20 08:55:56,259 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-20 08:55:56,259 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:56,259 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:55:56,259 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:55:56,260 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-20 08:55:56,260 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:55:56,260 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:56,260 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-20 08:55:56,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:56,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:55:56,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:55:56,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:55:56,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:55:56,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:56,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:56,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:55:56,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:56,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:56,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:55:56,263 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-20 08:55:56,263 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-20 08:55:56,263 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:55:56,263 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:55:56,263 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:56,263 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:55:56,265 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:56,265 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:56,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:56,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:56,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:55:56,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:55:56,265 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:55:56,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:56,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:55:56,265 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:56,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:55:56,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:55:56,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:56,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:56,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:55:56,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:56,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:56,266 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:56,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:55:56,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:56,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:56,272 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:56,272 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:56,272 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:55:56,272 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:55:56,272 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-20 08:55:56,272 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:55:56,272 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:56,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:55:56,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:55:56,272 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:55:56,273 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:56,273 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:56,273 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-20 08:55:56,273 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:56,273 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:55:56,273 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:56,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:55:56,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:55:56,373 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:55:56,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:55:56,377 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:55:56,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-20 08:55:56,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:56,379 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-20 08:55:56,379 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:55:56,379 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-20 08:55:56,379 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-20 08:55:56,379 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:56,379 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:56,381 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:56,381 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:55:56,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:55:56,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:55:56,381 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:56,381 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:55:56,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:56,381 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:56,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:55:56,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:56,382 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:56,382 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-20 08:55:56,382 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:56,382 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-20 08:55:56,382 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:55:56,382 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-20 08:55:56,383 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-20 08:55:56,383 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:55:56,383 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700470551767.ca958e54adf0d4e15cf293b5a4212aec. 2023-11-20 08:55:56,383 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700470551767.ca958e54adf0d4e15cf293b5a4212aec. started... 2023-11-20 08:55:56,383 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ca958e54adf0d4e15cf293b5a4212aec 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-20 08:55:56,801 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205734f48c179de47f89437aa89c2940556 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205734f48c179de47f89437aa89c2940556 2023-11-20 08:55:57,206 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/.tmp/family1/f43c7cb88d624ded95b40211fe5332a1 2023-11-20 08:55:57,210 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/.tmp/family1/f43c7cb88d624ded95b40211fe5332a1 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/f43c7cb88d624ded95b40211fe5332a1 2023-11-20 08:55:57,213 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/f43c7cb88d624ded95b40211fe5332a1, entries=1, sequenceid=17, filesize=4.9 K 2023-11-20 08:55:57,214 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ca958e54adf0d4e15cf293b5a4212aec in 831ms, sequenceid=17, compaction requested=true 2023-11-20 08:55:57,214 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ca958e54adf0d4e15cf293b5a4212aec: 2023-11-20 08:55:57,214 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700470551767.ca958e54adf0d4e15cf293b5a4212aec. 2023-11-20 08:55:57,214 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-20 08:55:57,214 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-20 08:55:57,214 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:57,214 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-20 08:55:57,214 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-20 08:55:57,216 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:57,216 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:57,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:57,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:55:57,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:55:57,216 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:57,216 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:55:57,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:55:57,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:55:57,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:57,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:57,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:55:57,217 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-20 08:55:57,217 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1cb7cfda[Count = 0] remaining members to acquire global barrier 2023-11-20 08:55:57,217 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-20 08:55:57,218 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:57,219 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:57,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:57,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:57,219 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-20 08:55:57,219 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-20 08:55:57,219 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:55:57,219 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:57,219 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:55:57,220 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:57,220 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-20 08:55:57,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:57,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:55:57,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:55:57,220 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:55:57,220 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-20 08:55:57,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:55:57,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:55:57,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:57,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:57,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:55:57,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:57,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:57,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:55:57,222 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-20 08:55:57,222 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-20 08:55:57,222 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:55:57,222 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:55:57,222 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:57,222 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:55:57,224 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:57,225 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:57,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:57,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:55:57,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:55:57,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:57,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:57,225 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:55:57,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:55:57,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:55:57,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:55:57,225 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:57,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:57,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:57,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:55:57,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:57,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:57,226 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:57,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:55:57,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:57,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:57,228 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:55:57,228 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:57,228 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:55:57,228 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:57,229 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-20 08:55:57,229 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:55:57,228 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:55:57,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:55:57,229 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-20 08:55:57,229 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:57,229 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-20 08:55:57,229 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:55:57,229 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:55:57,229 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:57,229 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:57,229 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:57,229 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:57,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:55:57,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:55:57,329 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:55:57,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:55:57,334 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:55:57,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-20 08:55:57,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:57,335 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-20 08:55:57,335 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:55:57,335 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-20 08:55:57,335 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-20 08:55:57,336 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:57,336 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:57,337 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:55:57,337 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:57,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:55:57,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:55:57,338 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:57,338 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:55:57,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:57,338 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:57,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:55:57,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:57,338 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:57,338 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-20 08:55:57,339 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:57,339 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-20 08:55:57,339 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:55:57,339 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-20 08:55:57,339 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-20 08:55:57,339 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:55:57,339 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700470551767.ca958e54adf0d4e15cf293b5a4212aec. 2023-11-20 08:55:57,339 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700470551767.ca958e54adf0d4e15cf293b5a4212aec. started... 2023-11-20 08:55:57,339 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ca958e54adf0d4e15cf293b5a4212aec 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-20 08:55:57,753 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122887b3979621a548819ff0d7842c4a6a8a to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015122887b3979621a548819ff0d7842c4a6a8a 2023-11-20 08:55:58,158 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/.tmp/family1/0a2520a3ddd94981aaef7b8422b48d1a 2023-11-20 08:55:58,162 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/.tmp/family1/0a2520a3ddd94981aaef7b8422b48d1a as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/0a2520a3ddd94981aaef7b8422b48d1a 2023-11-20 08:55:58,165 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/0a2520a3ddd94981aaef7b8422b48d1a, entries=1, sequenceid=21, filesize=4.9 K 2023-11-20 08:55:58,166 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ca958e54adf0d4e15cf293b5a4212aec in 827ms, sequenceid=21, compaction requested=true 2023-11-20 08:55:58,166 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ca958e54adf0d4e15cf293b5a4212aec: 2023-11-20 08:55:58,166 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700470551767.ca958e54adf0d4e15cf293b5a4212aec. 2023-11-20 08:55:58,166 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-20 08:55:58,166 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-20 08:55:58,166 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:58,166 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-20 08:55:58,166 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-20 08:55:58,168 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:58,168 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:58,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:58,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:55:58,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:55:58,168 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:58,168 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:55:58,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:55:58,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:55:58,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:58,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:58,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:55:58,169 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-20 08:55:58,170 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2fe4ff1f[Count = 0] remaining members to acquire global barrier 2023-11-20 08:55:58,170 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-20 08:55:58,170 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:58,172 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:58,172 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:58,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:58,172 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-20 08:55:58,172 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-20 08:55:58,172 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:55:58,172 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:58,172 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:55:58,173 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:58,173 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-20 08:55:58,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:58,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:55:58,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:55:58,173 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:55:58,174 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-20 08:55:58,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:55:58,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:55:58,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:58,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:58,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:55:58,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:58,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:58,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:55:58,176 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-20 08:55:58,176 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-20 08:55:58,176 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:55:58,176 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:55:58,176 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:58,176 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:55:58,177 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:58,177 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:58,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:58,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:55:58,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:55:58,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:58,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:58,177 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:55:58,178 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:58,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:55:58,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:55:58,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:55:58,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:58,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:58,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:55:58,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:58,179 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:58,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:58,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:55:58,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:58,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:58,181 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:58,181 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:58,181 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:58,181 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:55:58,181 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:58,181 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:58,181 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:58,181 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:58,181 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-20 08:55:58,181 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:55:58,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:55:58,181 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:55:58,181 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:55:58,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:55:58,181 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-20 08:55:58,182 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-20 08:55:58,182 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:55:58,182 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:55:58,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:55:58,282 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:55:58,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:55:58,286 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:55:58,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-20 08:55:58,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:58,287 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-20 08:55:58,287 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:55:58,287 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-20 08:55:58,287 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-20 08:55:58,288 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:58,288 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:58,290 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:58,290 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:55:58,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:55:58,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:55:58,290 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:58,290 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:55:58,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:58,290 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:58,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:55:58,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:58,291 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:58,291 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-20 08:55:58,291 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:58,291 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-20 08:55:58,291 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:55:58,291 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-20 08:55:58,291 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-20 08:55:58,291 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:55:58,291 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700470551767.ca958e54adf0d4e15cf293b5a4212aec. 2023-11-20 08:55:58,291 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700470551767.ca958e54adf0d4e15cf293b5a4212aec. started... 2023-11-20 08:55:58,291 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ca958e54adf0d4e15cf293b5a4212aec 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-20 08:55:58,450 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-20 08:55:58,702 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512314273d639fa79463c857d610081be4d9a to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512314273d639fa79463c857d610081be4d9a 2023-11-20 08:55:59,107 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/.tmp/family1/0518598a3d9e4e79bfc4f9cfd7aaa134 2023-11-20 08:55:59,111 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/.tmp/family1/0518598a3d9e4e79bfc4f9cfd7aaa134 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/0518598a3d9e4e79bfc4f9cfd7aaa134 2023-11-20 08:55:59,114 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/0518598a3d9e4e79bfc4f9cfd7aaa134, entries=1, sequenceid=25, filesize=4.9 K 2023-11-20 08:55:59,115 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ca958e54adf0d4e15cf293b5a4212aec in 824ms, sequenceid=25, compaction requested=true 2023-11-20 08:55:59,115 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ca958e54adf0d4e15cf293b5a4212aec: 2023-11-20 08:55:59,115 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700470551767.ca958e54adf0d4e15cf293b5a4212aec. 2023-11-20 08:55:59,115 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-20 08:55:59,115 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-20 08:55:59,115 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:59,115 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-20 08:55:59,115 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-20 08:55:59,117 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:59,117 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:59,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:59,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:55:59,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:55:59,117 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:59,117 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:55:59,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:55:59,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:55:59,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:59,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:59,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:55:59,119 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-20 08:55:59,119 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6373bb3b[Count = 0] remaining members to acquire global barrier 2023-11-20 08:55:59,119 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-20 08:55:59,119 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:59,120 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:59,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:59,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:59,120 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-20 08:55:59,120 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-20 08:55:59,120 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:55:59,120 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:59,120 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:55:59,125 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:59,125 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-20 08:55:59,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:59,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:55:59,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:55:59,125 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:55:59,125 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-20 08:55:59,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:55:59,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:55:59,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:59,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:59,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:55:59,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:59,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:59,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:55:59,127 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-20 08:55:59,127 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-20 08:55:59,127 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:55:59,127 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:55:59,127 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:59,127 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:55:59,129 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:59,129 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:59,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:59,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:55:59,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:55:59,129 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:55:59,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:59,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:59,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:55:59,129 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:59,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:55:59,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:55:59,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:59,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:59,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:55:59,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:59,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:59,131 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:59,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:55:59,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:59,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:59,133 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:59,133 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:59,133 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:55:59,133 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:59,133 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:55:59,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:55:59,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:55:59,133 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:55:59,133 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:59,133 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-20 08:55:59,133 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:55:59,133 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:59,133 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:59,133 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:59,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:55:59,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:55:59,134 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-20 08:55:59,134 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:55:59,234 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:55:59,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:55:59,238 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:55:59,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-20 08:55:59,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:59,239 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-20 08:55:59,239 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:55:59,239 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-20 08:55:59,239 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-20 08:55:59,240 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:59,240 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:59,242 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:59,242 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:55:59,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:55:59,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:55:59,242 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:55:59,242 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:55:59,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:59,242 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:59,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:55:59,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:59,243 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:59,243 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-20 08:55:59,243 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-20 08:55:59,243 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-20 08:55:59,243 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:55:59,243 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-20 08:55:59,243 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-20 08:55:59,243 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:55:59,243 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700470551767.ca958e54adf0d4e15cf293b5a4212aec. 2023-11-20 08:55:59,243 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700470551767.ca958e54adf0d4e15cf293b5a4212aec. started... 2023-11-20 08:55:59,243 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ca958e54adf0d4e15cf293b5a4212aec 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-20 08:55:59,654 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101bdbbb4798d824e3295d04cbd131b54b8 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160101bdbbb4798d824e3295d04cbd131b54b8 2023-11-20 08:56:00,059 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/.tmp/family1/789fda0f1abd4f2d92761fe1784030f2 2023-11-20 08:56:00,064 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/.tmp/family1/789fda0f1abd4f2d92761fe1784030f2 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/789fda0f1abd4f2d92761fe1784030f2 2023-11-20 08:56:00,067 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/789fda0f1abd4f2d92761fe1784030f2, entries=1, sequenceid=29, filesize=4.9 K 2023-11-20 08:56:00,068 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ca958e54adf0d4e15cf293b5a4212aec in 825ms, sequenceid=29, compaction requested=true 2023-11-20 08:56:00,068 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ca958e54adf0d4e15cf293b5a4212aec: 2023-11-20 08:56:00,068 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700470551767.ca958e54adf0d4e15cf293b5a4212aec. 2023-11-20 08:56:00,068 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-20 08:56:00,068 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-20 08:56:00,068 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:00,068 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-20 08:56:00,068 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-20 08:56:00,070 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:00,070 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:00,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:00,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:56:00,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:56:00,070 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:00,070 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:56:00,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:56:00,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:56:00,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:00,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:00,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:56:00,072 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-20 08:56:00,072 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6a836759[Count = 0] remaining members to acquire global barrier 2023-11-20 08:56:00,072 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-20 08:56:00,072 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:00,073 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:00,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:00,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:00,073 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-20 08:56:00,073 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-20 08:56:00,073 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:56:00,073 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:00,073 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:56:00,074 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:00,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:00,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:56:00,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:56:00,074 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-20 08:56:00,075 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:56:00,075 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-20 08:56:00,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:56:00,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:56:00,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:00,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:00,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:56:00,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:00,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:00,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:56:00,077 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-20 08:56:00,077 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-20 08:56:00,077 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:56:00,077 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:56:00,077 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:00,077 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:56:00,079 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:00,079 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:00,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:00,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:00,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:56:00,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:56:00,080 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:56:00,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:00,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:56:00,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:56:00,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:56:00,080 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:00,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:00,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:00,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:56:00,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:00,081 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:00,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:00,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:56:00,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:00,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:00,084 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:00,084 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:00,084 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:00,084 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-20 08:56:00,084 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:56:00,084 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:56:00,084 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:00,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:56:00,084 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:56:00,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:56:00,085 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-20 08:56:00,085 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:56:00,084 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:00,084 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-20 08:56:00,084 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:56:00,085 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:00,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:56:00,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:56:00,085 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:00,185 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:56:00,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:56:00,189 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:56:00,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-20 08:56:00,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:00,191 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-20 08:56:00,191 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:56:00,191 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-20 08:56:00,191 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-20 08:56:00,191 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:00,191 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:00,193 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:56:00,193 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:00,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:56:00,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:56:00,193 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:00,193 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:56:00,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:00,193 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:00,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:56:00,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:00,194 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:00,194 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-20 08:56:00,194 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:00,194 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-20 08:56:00,194 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:56:00,194 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-20 08:56:00,194 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-20 08:56:00,194 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:56:00,194 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700470551767.ca958e54adf0d4e15cf293b5a4212aec. 2023-11-20 08:56:00,194 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700470551767.ca958e54adf0d4e15cf293b5a4212aec. started... 2023-11-20 08:56:00,194 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ca958e54adf0d4e15cf293b5a4212aec 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-20 08:56:00,606 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601037c4b8461d3324e45bc1f747e375a5e0f to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601037c4b8461d3324e45bc1f747e375a5e0f 2023-11-20 08:56:01,011 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/.tmp/family1/9a87cb266ee040a3b4f516faaebdd270 2023-11-20 08:56:01,014 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/.tmp/family1/9a87cb266ee040a3b4f516faaebdd270 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/9a87cb266ee040a3b4f516faaebdd270 2023-11-20 08:56:01,017 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/9a87cb266ee040a3b4f516faaebdd270, entries=1, sequenceid=33, filesize=4.9 K 2023-11-20 08:56:01,018 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ca958e54adf0d4e15cf293b5a4212aec in 824ms, sequenceid=33, compaction requested=true 2023-11-20 08:56:01,018 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ca958e54adf0d4e15cf293b5a4212aec: 2023-11-20 08:56:01,018 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700470551767.ca958e54adf0d4e15cf293b5a4212aec. 2023-11-20 08:56:01,018 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-20 08:56:01,018 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-20 08:56:01,018 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:01,018 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-20 08:56:01,018 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-20 08:56:01,020 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:01,020 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:01,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:01,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:56:01,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:56:01,020 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:01,020 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:56:01,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:56:01,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:56:01,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:01,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:01,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:56:01,022 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-20 08:56:01,022 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@48e8bccc[Count = 0] remaining members to acquire global barrier 2023-11-20 08:56:01,022 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-20 08:56:01,022 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:01,024 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:01,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:01,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:01,024 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-20 08:56:01,024 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-20 08:56:01,024 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:56:01,024 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:01,024 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:56:01,026 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-20 08:56:01,026 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:01,026 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:56:01,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:01,026 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-20 08:56:01,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:56:01,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:56:01,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:56:01,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:56:01,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:01,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:01,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:56:01,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:01,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:01,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:56:01,028 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-20 08:56:01,028 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-20 08:56:01,028 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:56:01,028 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:56:01,028 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:01,028 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:56:01,030 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:01,030 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:01,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:01,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:01,030 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:56:01,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:01,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:56:01,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:56:01,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:56:01,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:56:01,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:56:01,031 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:01,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:01,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:01,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:56:01,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:01,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:01,032 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:01,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:56:01,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:01,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:01,034 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:01,034 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:01,034 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:01,034 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:56:01,034 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:56:01,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:56:01,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:56:01,034 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:56:01,034 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-20 08:56:01,034 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:56:01,034 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:01,035 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:01,035 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:01,035 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:01,035 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-20 08:56:01,035 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:56:01,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:56:01,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:56:01,135 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:56:01,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:56:01,139 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:56:01,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-20 08:56:01,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:01,141 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-20 08:56:01,141 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:56:01,141 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-20 08:56:01,141 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-20 08:56:01,141 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:01,141 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:01,146 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:01,146 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:56:01,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:56:01,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:56:01,147 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:01,147 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:56:01,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:01,147 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:01,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:56:01,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:01,147 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:01,148 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-20 08:56:01,148 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:01,148 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-20 08:56:01,148 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:56:01,148 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-20 08:56:01,148 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-20 08:56:01,148 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:56:01,148 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700470551767.ca958e54adf0d4e15cf293b5a4212aec. 2023-11-20 08:56:01,148 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700470551767.ca958e54adf0d4e15cf293b5a4212aec. started... 2023-11-20 08:56:01,148 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ca958e54adf0d4e15cf293b5a4212aec 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-20 08:56:01,558 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090771e190a8429c4733b9a00f0f02df1733 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015090771e190a8429c4733b9a00f0f02df1733 2023-11-20 08:56:01,963 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/.tmp/family1/f4124bacc2154066b9da727a6858e26d 2023-11-20 08:56:01,967 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/.tmp/family1/f4124bacc2154066b9da727a6858e26d as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/f4124bacc2154066b9da727a6858e26d 2023-11-20 08:56:01,969 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/f4124bacc2154066b9da727a6858e26d, entries=1, sequenceid=37, filesize=4.9 K 2023-11-20 08:56:01,970 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ca958e54adf0d4e15cf293b5a4212aec in 822ms, sequenceid=37, compaction requested=true 2023-11-20 08:56:01,970 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ca958e54adf0d4e15cf293b5a4212aec: 2023-11-20 08:56:01,970 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700470551767.ca958e54adf0d4e15cf293b5a4212aec. 2023-11-20 08:56:01,970 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-20 08:56:01,970 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-20 08:56:01,970 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:01,971 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-20 08:56:01,971 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-20 08:56:01,980 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:01,980 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:01,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:01,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:56:01,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:56:01,980 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:01,980 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:56:01,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:56:01,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:56:01,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:01,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:01,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:56:01,981 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-20 08:56:01,982 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@40fcbec9[Count = 0] remaining members to acquire global barrier 2023-11-20 08:56:01,982 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-20 08:56:01,982 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:01,983 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:01,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:01,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:01,983 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-20 08:56:01,983 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-20 08:56:01,983 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:01,983 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:56:01,983 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:56:01,984 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-20 08:56:01,984 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:56:01,984 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:01,984 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-20 08:56:01,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:01,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:56:01,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:56:01,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:56:01,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:56:01,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:01,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:01,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:56:01,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:01,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:01,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:56:01,987 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-20 08:56:01,987 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-20 08:56:01,987 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:56:01,987 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:56:01,987 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:01,987 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:56:01,989 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:01,989 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:01,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:01,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:56:01,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:56:01,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:01,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:01,990 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:56:01,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:56:01,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:56:01,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:56:01,990 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:01,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:01,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:01,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:56:01,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:01,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:01,991 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:01,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:56:01,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:01,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:01,994 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:01,994 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:01,994 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:01,994 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:56:01,994 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:56:01,994 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:01,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:56:01,994 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:56:01,994 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-20 08:56:01,994 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:56:01,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:56:01,994 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:01,994 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:01,994 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:01,995 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-20 08:56:01,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:56:01,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:56:01,995 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:56:02,095 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:56:02,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:56:02,099 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:56:02,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-20 08:56:02,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:02,101 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-20 08:56:02,101 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:56:02,101 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-20 08:56:02,101 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-20 08:56:02,101 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:02,101 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:02,102 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:02,102 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:56:02,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:56:02,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:56:02,103 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:02,103 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:56:02,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:02,103 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:02,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:56:02,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:02,104 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:02,104 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-20 08:56:02,104 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:02,104 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-20 08:56:02,104 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:56:02,104 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-20 08:56:02,104 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-20 08:56:02,104 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:56:02,104 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700470551767.ca958e54adf0d4e15cf293b5a4212aec. 2023-11-20 08:56:02,104 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700470551767.ca958e54adf0d4e15cf293b5a4212aec. started... 2023-11-20 08:56:02,105 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ca958e54adf0d4e15cf293b5a4212aec 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-20 08:56:02,515 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112061e0a6bea4574afcab326323fd10612c to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015112061e0a6bea4574afcab326323fd10612c 2023-11-20 08:56:02,920 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/.tmp/family1/b3e9579c95074e5e8729068a29bdb042 2023-11-20 08:56:02,924 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/.tmp/family1/b3e9579c95074e5e8729068a29bdb042 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/b3e9579c95074e5e8729068a29bdb042 2023-11-20 08:56:02,927 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/b3e9579c95074e5e8729068a29bdb042, entries=1, sequenceid=41, filesize=4.9 K 2023-11-20 08:56:02,928 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ca958e54adf0d4e15cf293b5a4212aec in 824ms, sequenceid=41, compaction requested=true 2023-11-20 08:56:02,928 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ca958e54adf0d4e15cf293b5a4212aec: 2023-11-20 08:56:02,928 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700470551767.ca958e54adf0d4e15cf293b5a4212aec. 2023-11-20 08:56:02,928 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-20 08:56:02,928 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-20 08:56:02,928 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:02,928 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-20 08:56:02,928 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-20 08:56:02,930 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:02,930 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:02,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:02,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:56:02,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:56:02,930 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:02,930 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:56:02,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:56:02,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:56:02,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:02,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:02,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:56:02,931 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-20 08:56:02,931 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3ea86f8e[Count = 0] remaining members to acquire global barrier 2023-11-20 08:56:02,931 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-20 08:56:02,931 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:02,934 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:02,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:02,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:02,934 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-20 08:56:02,934 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-20 08:56:02,934 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:56:02,934 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:02,934 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:56:02,935 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:02,935 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-20 08:56:02,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:02,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:56:02,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:56:02,935 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:56:02,936 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-20 08:56:02,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:56:02,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:56:02,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:02,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:02,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:56:02,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:02,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:02,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:56:02,938 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-20 08:56:02,938 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-20 08:56:02,938 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:56:02,938 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:56:02,938 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:02,938 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:56:02,939 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:02,939 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:02,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:02,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:02,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:56:02,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:02,940 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:56:02,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:56:02,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:56:02,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:56:02,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:56:02,940 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:02,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:02,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:02,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:56:02,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:02,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:02,941 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:02,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:56:02,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:02,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:02,944 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:02,944 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:02,944 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:56:02,944 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:56:02,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:56:02,944 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:02,944 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:56:02,944 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:02,944 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-20 08:56:02,944 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:02,944 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:02,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:56:02,944 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:02,944 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:56:02,945 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-20 08:56:02,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:56:02,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:56:02,945 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:56:03,045 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:56:03,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:56:03,047 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=36169] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMinorCompactionWithMonthlyPolicy 2023-11-20 08:56:03,048 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] procedure2.ProcedureExecutor(1028): Stored pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-20 08:56:03,049 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-20 08:56:03,050 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-20 08:56:03,050 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=115, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700471163050 2023-11-20 08:56:03,052 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-20 08:56:03,053 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMinorCompactionWithMonthlyPolicy' and column 'family1' 2023-11-20 08:56:03,053 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-20 08:56:03,054 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] zookeeper.ReadOnlyZKClient(139): Connect 0x3bcbd0eb to 127.0.0.1:64635 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-20 08:56:03,060 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5995854, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-20 08:56:03,060 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-20 08:56:03,487 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010364891f2b2801450fbc131a528a776380 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010364891f2b2801450fbc131a528a776380 2023-11-20 08:56:03,488 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-20 08:56:03,502 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-20 08:56:03,504 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60978, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-20 08:56:03,509 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-20 08:56:03,510 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33384, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-20 08:56:03,518 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/6d5582a0a1ae42ce91c55358fd88a268 first=Optional[r5] last=Optional[r6] 2023-11-20 08:56:03,519 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1700470551767.ca958e54adf0d4e15cf293b5a4212aec., hostname=jenkins-hbase4.apache.org,38491,1700470412215, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/6d5582a0a1ae42ce91c55358fd88a268}] 2023-11-20 08:56:03,525 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HStore(763): Validating hfile at hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/6d5582a0a1ae42ce91c55358fd88a268 for inclusion in ca958e54adf0d4e15cf293b5a4212aec/family1 2023-11-20 08:56:03,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-11-20 08:56:03,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HStore(777): Region bounds: first= last= 2023-11-20 08:56:03,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HRegion(2446): Flush status journal for ca958e54adf0d4e15cf293b5a4212aec: 2023-11-20 08:56:03,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/6d5582a0a1ae42ce91c55358fd88a268 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMinorCompactionWithMonthlyPolicy__c34pfnsq378aq75063ubqchut62sofi8pok94j6c8b32m27gmpf2q9l21p04ggdm/family1/6d5582a0a1ae42ce91c55358fd88a268 2023-11-20 08:56:03,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMinorCompactionWithMonthlyPolicy__c34pfnsq378aq75063ubqchut62sofi8pok94j6c8b32m27gmpf2q9l21p04ggdm/family1/6d5582a0a1ae42ce91c55358fd88a268 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/0440e74e273246b7b61e5e2efcd98b58_SeqId_44_ 2023-11-20 08:56:03,530 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HStore(849): Loaded HFile hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMinorCompactionWithMonthlyPolicy__c34pfnsq378aq75063ubqchut62sofi8pok94j6c8b32m27gmpf2q9l21p04ggdm/family1/6d5582a0a1ae42ce91c55358fd88a268 into ca958e54adf0d4e15cf293b5a4212aec/family1 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/0440e74e273246b7b61e5e2efcd98b58_SeqId_44_ - updating store file list. 2023-11-20 08:56:03,533 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HStore(882): Loaded HFile hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/0440e74e273246b7b61e5e2efcd98b58_SeqId_44_ into ca958e54adf0d4e15cf293b5a4212aec/family1 2023-11-20 08:56:03,533 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HStore(855): Successfully loaded hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMinorCompactionWithMonthlyPolicy__c34pfnsq378aq75063ubqchut62sofi8pok94j6c8b32m27gmpf2q9l21p04ggdm/family1/6d5582a0a1ae42ce91c55358fd88a268 into ca958e54adf0d4e15cf293b5a4212aec/family1 (new location: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/0440e74e273246b7b61e5e2efcd98b58_SeqId_44_) 2023-11-20 08:56:03,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMinorCompactionWithMonthlyPolicy__c34pfnsq378aq75063ubqchut62sofi8pok94j6c8b32m27gmpf2q9l21p04ggdm/family1/6d5582a0a1ae42ce91c55358fd88a268 2023-11-20 08:56:03,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-20 08:56:03,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-20 08:56:03,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HStore(1912): ca958e54adf0d4e15cf293b5a4212aec/family1 is initiating minor compaction 2023-11-20 08:56:03,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7f8148b4; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-20 08:56:03,536 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of ca958e54adf0d4e15cf293b5a4212aec/family1 in testMinorCompactionWithMonthlyPolicy,,1700470551767.ca958e54adf0d4e15cf293b5a4212aec. 2023-11-20 08:56:03,536 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/2e8a3e5f0764454290bae5cff3edb2be, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/1c04ac6ebf264ab09eb3d47c2352ac82, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/f43c7cb88d624ded95b40211fe5332a1, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/0a2520a3ddd94981aaef7b8422b48d1a, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/0518598a3d9e4e79bfc4f9cfd7aaa134, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/789fda0f1abd4f2d92761fe1784030f2, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/9a87cb266ee040a3b4f516faaebdd270, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/f4124bacc2154066b9da727a6858e26d, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/b3e9579c95074e5e8729068a29bdb042, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/0440e74e273246b7b61e5e2efcd98b58_SeqId_44_] into tmpdir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/.tmp, totalSize=49.7 K 2023-11-20 08:56:03,536 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting 2e8a3e5f0764454290bae5cff3edb2be, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-20 08:56:03,536 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting 1c04ac6ebf264ab09eb3d47c2352ac82, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-20 08:56:03,536 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting f43c7cb88d624ded95b40211fe5332a1, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-20 08:56:03,536 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting 0a2520a3ddd94981aaef7b8422b48d1a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-20 08:56:03,536 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting 0518598a3d9e4e79bfc4f9cfd7aaa134, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-20 08:56:03,536 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting 789fda0f1abd4f2d92761fe1784030f2, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-20 08:56:03,536 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting 9a87cb266ee040a3b4f516faaebdd270, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-20 08:56:03,536 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting f4124bacc2154066b9da727a6858e26d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-20 08:56:03,536 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting b3e9579c95074e5e8729068a29bdb042, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-20 08:56:03,536 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting 0440e74e273246b7b61e5e2efcd98b58_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-20 08:56:03,537 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-20 08:56:03,538 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:56:03,539 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160101bdbbb4798d824e3295d04cbd131b54b8 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160101bdbbb4798d824e3295d04cbd131b54b8 2023-11-20 08:56:03,540 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601037c4b8461d3324e45bc1f747e375a5e0f to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601037c4b8461d3324e45bc1f747e375a5e0f 2023-11-20 08:56:03,541 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-11-20 08:56:03,541 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-11-20 08:56:03,541 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-20 08:56:03,541 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-20 08:56:03,569 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] throttle.PressureAwareThroughputController(145): ca958e54adf0d4e15cf293b5a4212aec#family1#compaction#165 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-11-20 08:56:03,989 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/.tmp/family1/9fad578248e442bf9b56854523db8429 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/9fad578248e442bf9b56854523db8429 2023-11-20 08:56:03,994 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in ca958e54adf0d4e15cf293b5a4212aec/family1 of ca958e54adf0d4e15cf293b5a4212aec into 9fad578248e442bf9b56854523db8429(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-20 08:56:03,995 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for ca958e54adf0d4e15cf293b5a4212aec: 2023-11-20 08:56:03,995 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1700470551767.ca958e54adf0d4e15cf293b5a4212aec., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1700470563536; duration=0sec 2023-11-20 08:56:03,995 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-20 08:56:04,035 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/2e8a3e5f0764454290bae5cff3edb2be, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/1c04ac6ebf264ab09eb3d47c2352ac82, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/f43c7cb88d624ded95b40211fe5332a1, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/0a2520a3ddd94981aaef7b8422b48d1a, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/0518598a3d9e4e79bfc4f9cfd7aaa134, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/789fda0f1abd4f2d92761fe1784030f2, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/9a87cb266ee040a3b4f516faaebdd270, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/f4124bacc2154066b9da727a6858e26d, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/b3e9579c95074e5e8729068a29bdb042, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/0440e74e273246b7b61e5e2efcd98b58_SeqId_44_] to archive 2023-11-20 08:56:04,036 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:56:04,038 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/2e8a3e5f0764454290bae5cff3edb2be to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/2e8a3e5f0764454290bae5cff3edb2be 2023-11-20 08:56:04,039 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/1c04ac6ebf264ab09eb3d47c2352ac82 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/1c04ac6ebf264ab09eb3d47c2352ac82 2023-11-20 08:56:04,040 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/f43c7cb88d624ded95b40211fe5332a1 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/f43c7cb88d624ded95b40211fe5332a1 2023-11-20 08:56:04,042 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/0a2520a3ddd94981aaef7b8422b48d1a to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/0a2520a3ddd94981aaef7b8422b48d1a 2023-11-20 08:56:04,043 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/0518598a3d9e4e79bfc4f9cfd7aaa134 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/0518598a3d9e4e79bfc4f9cfd7aaa134 2023-11-20 08:56:04,044 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/789fda0f1abd4f2d92761fe1784030f2 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/789fda0f1abd4f2d92761fe1784030f2 2023-11-20 08:56:04,045 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/9a87cb266ee040a3b4f516faaebdd270 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/9a87cb266ee040a3b4f516faaebdd270 2023-11-20 08:56:04,046 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/f4124bacc2154066b9da727a6858e26d to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/f4124bacc2154066b9da727a6858e26d 2023-11-20 08:56:04,047 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/b3e9579c95074e5e8729068a29bdb042 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/b3e9579c95074e5e8729068a29bdb042 2023-11-20 08:56:04,048 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/0440e74e273246b7b61e5e2efcd98b58_SeqId_44_ to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/0440e74e273246b7b61e5e2efcd98b58_SeqId_44_ 2023-11-20 08:56:04,387 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231ea8e2fc0caf84c5c9c45302a3a218d3c to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231ea8e2fc0caf84c5c9c45302a3a218d3c 2023-11-20 08:56:04,388 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-20 08:56:04,409 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/e113b3ae948741d6b1ab18de95b6e0b5 first=Optional[r1] last=Optional[r4] 2023-11-20 08:56:04,410 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1700470551767.ca958e54adf0d4e15cf293b5a4212aec., hostname=jenkins-hbase4.apache.org,38491,1700470412215, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/e113b3ae948741d6b1ab18de95b6e0b5}] 2023-11-20 08:56:04,412 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HStore(763): Validating hfile at hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/e113b3ae948741d6b1ab18de95b6e0b5 for inclusion in ca958e54adf0d4e15cf293b5a4212aec/family1 2023-11-20 08:56:04,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-11-20 08:56:04,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HStore(777): Region bounds: first= last= 2023-11-20 08:56:04,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HRegion(2446): Flush status journal for ca958e54adf0d4e15cf293b5a4212aec: 2023-11-20 08:56:04,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/e113b3ae948741d6b1ab18de95b6e0b5 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMinorCompactionWithMonthlyPolicy__gut9ao1o2og08ljpqptnpmj3e5qhk1cu81q6ovh4qdf3r67hk3trrkbmqv137mok/family1/e113b3ae948741d6b1ab18de95b6e0b5 2023-11-20 08:56:04,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMinorCompactionWithMonthlyPolicy__gut9ao1o2og08ljpqptnpmj3e5qhk1cu81q6ovh4qdf3r67hk3trrkbmqv137mok/family1/e113b3ae948741d6b1ab18de95b6e0b5 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/54ef13cf73d34280b69ba056c9371e1e_SeqId_47_ 2023-11-20 08:56:04,417 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HStore(849): Loaded HFile hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMinorCompactionWithMonthlyPolicy__gut9ao1o2og08ljpqptnpmj3e5qhk1cu81q6ovh4qdf3r67hk3trrkbmqv137mok/family1/e113b3ae948741d6b1ab18de95b6e0b5 into ca958e54adf0d4e15cf293b5a4212aec/family1 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/54ef13cf73d34280b69ba056c9371e1e_SeqId_47_ - updating store file list. 2023-11-20 08:56:04,421 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HStore(882): Loaded HFile hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/54ef13cf73d34280b69ba056c9371e1e_SeqId_47_ into ca958e54adf0d4e15cf293b5a4212aec/family1 2023-11-20 08:56:04,421 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HStore(855): Successfully loaded hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMinorCompactionWithMonthlyPolicy__gut9ao1o2og08ljpqptnpmj3e5qhk1cu81q6ovh4qdf3r67hk3trrkbmqv137mok/family1/e113b3ae948741d6b1ab18de95b6e0b5 into ca958e54adf0d4e15cf293b5a4212aec/family1 (new location: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/54ef13cf73d34280b69ba056c9371e1e_SeqId_47_) 2023-11-20 08:56:04,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMinorCompactionWithMonthlyPolicy__gut9ao1o2og08ljpqptnpmj3e5qhk1cu81q6ovh4qdf3r67hk3trrkbmqv137mok/family1/e113b3ae948741d6b1ab18de95b6e0b5 2023-11-20 08:56:04,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-20 08:56:04,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-20 08:56:04,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HStore(1912): ca958e54adf0d4e15cf293b5a4212aec/family1 is initiating minor compaction (all files) 2023-11-20 08:56:04,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@cecdded; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-20 08:56:04,422 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of ca958e54adf0d4e15cf293b5a4212aec/family1 in testMinorCompactionWithMonthlyPolicy,,1700470551767.ca958e54adf0d4e15cf293b5a4212aec. 2023-11-20 08:56:04,422 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/413f36a1948048c6aa8cce4cfa9a9939, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/9fad578248e442bf9b56854523db8429, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/54ef13cf73d34280b69ba056c9371e1e_SeqId_47_] into tmpdir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/.tmp, totalSize=178.1 K 2023-11-20 08:56:04,422 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting 413f36a1948048c6aa8cce4cfa9a9939, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878836012 2023-11-20 08:56:04,423 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting 9fad578248e442bf9b56854523db8429, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621236012 2023-11-20 08:56:04,423 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] compactions.Compactor(207): Compacting 54ef13cf73d34280b69ba056c9371e1e_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965236012 2023-11-20 08:56:04,424 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-20 08:56:04,424 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:56:04,426 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151201378c35e5682c4e5ba5c7ea1227019812 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151201378c35e5682c4e5ba5c7ea1227019812 2023-11-20 08:56:04,427 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205734f48c179de47f89437aa89c2940556 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205734f48c179de47f89437aa89c2940556 2023-11-20 08:56:04,429 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015122887b3979621a548819ff0d7842c4a6a8a to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015122887b3979621a548819ff0d7842c4a6a8a 2023-11-20 08:56:04,430 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512314273d639fa79463c857d610081be4d9a to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512314273d639fa79463c857d610081be4d9a 2023-11-20 08:56:04,430 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-11-20 08:56:04,430 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-11-20 08:56:04,430 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-20 08:56:04,430 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-20 08:56:04,441 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] throttle.PressureAwareThroughputController(145): ca958e54adf0d4e15cf293b5a4212aec#family1#compaction#166 average throughput is 14.15 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-11-20 08:56:05,277 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/.tmp/family1/11fe1f08ebd94889aa0b33cf6cecfd05 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/11fe1f08ebd94889aa0b33cf6cecfd05 2023-11-20 08:56:05,278 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113008b0d58debdb47b0ae7bbdad089c2ef6 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015113008b0d58debdb47b0ae7bbdad089c2ef6 2023-11-20 08:56:05,279 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-20 08:56:05,281 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in ca958e54adf0d4e15cf293b5a4212aec/family1 of ca958e54adf0d4e15cf293b5a4212aec into 11fe1f08ebd94889aa0b33cf6cecfd05(size=167.4 K), total size for store is 167.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-20 08:56:05,282 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for ca958e54adf0d4e15cf293b5a4212aec: 2023-11-20 08:56:05,282 INFO [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1700470551767.ca958e54adf0d4e15cf293b5a4212aec., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1700470564422; duration=0sec 2023-11-20 08:56:05,282 DEBUG [RS:0;jenkins-hbase4:38491-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-20 08:56:05,300 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/db5d4774bc214563b69158caa7194180 first=Optional[r00] last=Optional[r8] 2023-11-20 08:56:05,301 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1700470551767.ca958e54adf0d4e15cf293b5a4212aec., hostname=jenkins-hbase4.apache.org,38491,1700470412215, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/db5d4774bc214563b69158caa7194180}] 2023-11-20 08:56:05,303 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HStore(763): Validating hfile at hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/db5d4774bc214563b69158caa7194180 for inclusion in ca958e54adf0d4e15cf293b5a4212aec/family1 2023-11-20 08:56:05,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-11-20 08:56:05,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HStore(777): Region bounds: first= last= 2023-11-20 08:56:05,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HRegion(2446): Flush status journal for ca958e54adf0d4e15cf293b5a4212aec: 2023-11-20 08:56:05,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/db5d4774bc214563b69158caa7194180 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMinorCompactionWithMonthlyPolicy__lq2fc7n60opjk70mtgvsci1o6rk8ap6egse0qqr9odmrerbl3vps76kl38qva0md/family1/db5d4774bc214563b69158caa7194180 2023-11-20 08:56:05,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMinorCompactionWithMonthlyPolicy__lq2fc7n60opjk70mtgvsci1o6rk8ap6egse0qqr9odmrerbl3vps76kl38qva0md/family1/db5d4774bc214563b69158caa7194180 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/af81290c7c86422a8c7c5c67ee7a3b33_SeqId_50_ 2023-11-20 08:56:05,308 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HStore(849): Loaded HFile hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMinorCompactionWithMonthlyPolicy__lq2fc7n60opjk70mtgvsci1o6rk8ap6egse0qqr9odmrerbl3vps76kl38qva0md/family1/db5d4774bc214563b69158caa7194180 into ca958e54adf0d4e15cf293b5a4212aec/family1 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/af81290c7c86422a8c7c5c67ee7a3b33_SeqId_50_ - updating store file list. 2023-11-20 08:56:05,310 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HStore(882): Loaded HFile hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/af81290c7c86422a8c7c5c67ee7a3b33_SeqId_50_ into ca958e54adf0d4e15cf293b5a4212aec/family1 2023-11-20 08:56:05,310 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HStore(855): Successfully loaded hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMinorCompactionWithMonthlyPolicy__lq2fc7n60opjk70mtgvsci1o6rk8ap6egse0qqr9odmrerbl3vps76kl38qva0md/family1/db5d4774bc214563b69158caa7194180 into ca958e54adf0d4e15cf293b5a4212aec/family1 (new location: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/af81290c7c86422a8c7c5c67ee7a3b33_SeqId_50_) 2023-11-20 08:56:05,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMinorCompactionWithMonthlyPolicy__lq2fc7n60opjk70mtgvsci1o6rk8ap6egse0qqr9odmrerbl3vps76kl38qva0md/family1/db5d4774bc214563b69158caa7194180 2023-11-20 08:56:05,312 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-20 08:56:05,313 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:56:05,314 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015112061e0a6bea4574afcab326323fd10612c to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015112061e0a6bea4574afcab326323fd10612c 2023-11-20 08:56:05,315 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128dfe6d62197ff41e39887ae73dcf4539e to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128dfe6d62197ff41e39887ae73dcf4539e 2023-11-20 08:56:05,316 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511306a00cb65fe2e4fe2860919735870cd7f to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511306a00cb65fe2e4fe2860919735870cd7f 2023-11-20 08:56:05,316 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-11-20 08:56:05,316 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-20 08:56:05,316 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-20 08:56:05,316 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-20 08:56:05,316 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-20 08:56:05,316 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-20 08:56:05,316 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-20 08:56:05,318 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=115, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-20 08:56:05,319 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=115, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 2.2710 sec 2023-11-20 08:56:05,326 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/413f36a1948048c6aa8cce4cfa9a9939, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/9fad578248e442bf9b56854523db8429, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/54ef13cf73d34280b69ba056c9371e1e_SeqId_47_] to archive 2023-11-20 08:56:05,326 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:56:05,328 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/413f36a1948048c6aa8cce4cfa9a9939 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/413f36a1948048c6aa8cce4cfa9a9939 2023-11-20 08:56:05,329 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/9fad578248e442bf9b56854523db8429 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/9fad578248e442bf9b56854523db8429 2023-11-20 08:56:05,330 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/54ef13cf73d34280b69ba056c9371e1e_SeqId_47_ to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/family1/54ef13cf73d34280b69ba056c9371e1e_SeqId_47_ 2023-11-20 08:56:05,522 INFO [Listener at localhost/43513] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=256 (was 251) - Thread LEAK? -, OpenFileDescriptor=679 (was 649) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=110 (was 111), ProcessCount=168 (was 168), AvailableMemoryMB=15092 (was 15098) 2023-11-20 08:56:05,534 INFO [Listener at localhost/43513] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=256, OpenFileDescriptor=679, MaxFileDescriptor=60000, SystemLoadAverage=110, ProcessCount=168, AvailableMemoryMB=15091 2023-11-20 08:56:05,553 DEBUG [Listener at localhost/43513] crypto.Encryption(565): Installed org.apache.hadoop.hbase.io.crypto.KeyProviderForTesting into key provider cache 2023-11-20 08:56:05,606 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x9Ex\xC6\xD1\xB8\x84\xEA\x85\xB9\x14\xEF\x84\x15\xF4v\xF5"\x104\x10m\xB3\x90C\xD9\xAC\xA9\xA8\xF1\xBC\xFFOU#*\x10\xBA\xEE|dF\x09\xF4\xE3!\xA8\x02\xF0\xC2H\x14n2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-20 08:56:05,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] procedure2.ProcedureExecutor(1028): Stored pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionFromAdmin 2023-11-20 08:56:05,609 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_PRE_OPERATION 2023-11-20 08:56:05,609 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionFromAdmin" procId is: 116 2023-11-20 08:56:05,609 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-20 08:56:05,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-20 08:56:05,611 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2 2023-11-20 08:56:05,611 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22 2023-11-20 08:56:05,611 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092 2023-11-20 08:56:05,612 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2 empty. 2023-11-20 08:56:05,612 DEBUG [HFileArchiver-22] backup.HFileArchiver(153): Directory hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092 empty. 2023-11-20 08:56:05,612 DEBUG [HFileArchiver-21] backup.HFileArchiver(153): Directory hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22 empty. 2023-11-20 08:56:05,612 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2 2023-11-20 08:56:05,612 DEBUG [HFileArchiver-22] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092 2023-11-20 08:56:05,612 DEBUG [HFileArchiver-21] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22 2023-11-20 08:56:05,612 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMajorCompactionFromAdmin regions 2023-11-20 08:56:05,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-20 08:56:05,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-20 08:56:06,020 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp/data/default/testMajorCompactionFromAdmin/.tabledesc/.tableinfo.0000000001 2023-11-20 08:56:06,021 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(7675): creating {ENCODED => cc3c29cf22b5437a5aba3278559c21c2, NAME => 'testMajorCompactionFromAdmin,,1700470565576.cc3c29cf22b5437a5aba3278559c21c2.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x9Ex\xC6\xD1\xB8\x84\xEA\x85\xB9\x14\xEF\x84\x15\xF4v\xF5"\x104\x10m\xB3\x90C\xD9\xAC\xA9\xA8\xF1\xBC\xFFOU#*\x10\xBA\xEE|dF\x09\xF4\xE3!\xA8\x02\xF0\xC2H\x14n2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp 2023-11-20 08:56:06,021 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(7675): creating {ENCODED => d2702cde56f0dcd71503062a3d396092, NAME => 'testMajorCompactionFromAdmin,2,1700470565576.d2702cde56f0dcd71503062a3d396092.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x9Ex\xC6\xD1\xB8\x84\xEA\x85\xB9\x14\xEF\x84\x15\xF4v\xF5"\x104\x10m\xB3\x90C\xD9\xAC\xA9\xA8\xF1\xBC\xFFOU#*\x10\xBA\xEE|dF\x09\xF4\xE3!\xA8\x02\xF0\xC2H\x14n2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp 2023-11-20 08:56:06,022 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(7675): creating {ENCODED => ad7b59ca054cb36c87ef2e1f35f17d22, NAME => 'testMajorCompactionFromAdmin,1,1700470565576.ad7b59ca054cb36c87ef2e1f35f17d22.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x9Ex\xC6\xD1\xB8\x84\xEA\x85\xB9\x14\xEF\x84\x15\xF4v\xF5"\x104\x10m\xB3\x90C\xD9\xAC\xA9\xA8\xF1\xBC\xFFOU#*\x10\xBA\xEE|dF\x09\xF4\xE3!\xA8\x02\xF0\xC2H\x14n2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/.tmp 2023-11-20 08:56:06,037 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1700470565576.d2702cde56f0dcd71503062a3d396092.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-20 08:56:06,037 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1604): Closing d2702cde56f0dcd71503062a3d396092, disabling compactions & flushes 2023-11-20 08:56:06,037 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1700470565576.d2702cde56f0dcd71503062a3d396092. 2023-11-20 08:56:06,038 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1700470565576.d2702cde56f0dcd71503062a3d396092. 2023-11-20 08:56:06,038 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1700470565576.d2702cde56f0dcd71503062a3d396092. after waiting 0 ms 2023-11-20 08:56:06,038 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1700470565576.d2702cde56f0dcd71503062a3d396092. 2023-11-20 08:56:06,038 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1700470565576.d2702cde56f0dcd71503062a3d396092. 2023-11-20 08:56:06,038 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1558): Region close journal for d2702cde56f0dcd71503062a3d396092: 2023-11-20 08:56:06,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-20 08:56:06,432 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1700470565576.cc3c29cf22b5437a5aba3278559c21c2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-20 08:56:06,432 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1604): Closing cc3c29cf22b5437a5aba3278559c21c2, disabling compactions & flushes 2023-11-20 08:56:06,432 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1700470565576.cc3c29cf22b5437a5aba3278559c21c2. 2023-11-20 08:56:06,432 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1700470565576.cc3c29cf22b5437a5aba3278559c21c2. 2023-11-20 08:56:06,432 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1700470565576.cc3c29cf22b5437a5aba3278559c21c2. after waiting 0 ms 2023-11-20 08:56:06,432 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1700470565576.cc3c29cf22b5437a5aba3278559c21c2. 2023-11-20 08:56:06,432 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1700470565576.cc3c29cf22b5437a5aba3278559c21c2. 2023-11-20 08:56:06,432 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1558): Region close journal for cc3c29cf22b5437a5aba3278559c21c2: 2023-11-20 08:56:06,438 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1700470565576.ad7b59ca054cb36c87ef2e1f35f17d22.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-20 08:56:06,438 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1604): Closing ad7b59ca054cb36c87ef2e1f35f17d22, disabling compactions & flushes 2023-11-20 08:56:06,438 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1700470565576.ad7b59ca054cb36c87ef2e1f35f17d22. 2023-11-20 08:56:06,438 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1700470565576.ad7b59ca054cb36c87ef2e1f35f17d22. 2023-11-20 08:56:06,438 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1700470565576.ad7b59ca054cb36c87ef2e1f35f17d22. after waiting 0 ms 2023-11-20 08:56:06,438 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1700470565576.ad7b59ca054cb36c87ef2e1f35f17d22. 2023-11-20 08:56:06,438 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1700470565576.ad7b59ca054cb36c87ef2e1f35f17d22. 2023-11-20 08:56:06,438 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1558): Region close journal for ad7b59ca054cb36c87ef2e1f35f17d22: 2023-11-20 08:56:06,440 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ADD_TO_META 2023-11-20 08:56:06,441 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,2,1700470565576.d2702cde56f0dcd71503062a3d396092.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700470566441"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700470566441"}]},"ts":"1700470566441"} 2023-11-20 08:56:06,441 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,,1700470565576.cc3c29cf22b5437a5aba3278559c21c2.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700470566441"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700470566441"}]},"ts":"1700470566441"} 2023-11-20 08:56:06,441 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,1,1700470565576.ad7b59ca054cb36c87ef2e1f35f17d22.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1700470566441"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700470566441"}]},"ts":"1700470566441"} 2023-11-20 08:56:06,443 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-20 08:56:06,443 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-20 08:56:06,443 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700470566443"}]},"ts":"1700470566443"} 2023-11-20 08:56:06,444 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLING in hbase:meta 2023-11-20 08:56:06,447 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=cc3c29cf22b5437a5aba3278559c21c2, ASSIGN}, {pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=ad7b59ca054cb36c87ef2e1f35f17d22, ASSIGN}, {pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=d2702cde56f0dcd71503062a3d396092, ASSIGN}] 2023-11-20 08:56:06,449 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=d2702cde56f0dcd71503062a3d396092, ASSIGN 2023-11-20 08:56:06,449 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=ad7b59ca054cb36c87ef2e1f35f17d22, ASSIGN 2023-11-20 08:56:06,449 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=cc3c29cf22b5437a5aba3278559c21c2, ASSIGN 2023-11-20 08:56:06,449 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=d2702cde56f0dcd71503062a3d396092, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38491,1700470412215; forceNewPlan=false, retain=false 2023-11-20 08:56:06,449 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=ad7b59ca054cb36c87ef2e1f35f17d22, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38491,1700470412215; forceNewPlan=false, retain=false 2023-11-20 08:56:06,449 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=cc3c29cf22b5437a5aba3278559c21c2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38491,1700470412215; forceNewPlan=false, retain=false 2023-11-20 08:56:06,601 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=cc3c29cf22b5437a5aba3278559c21c2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:06,601 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=ad7b59ca054cb36c87ef2e1f35f17d22, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:06,601 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,,1700470565576.cc3c29cf22b5437a5aba3278559c21c2.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700470566601"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700470566601"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700470566601"}]},"ts":"1700470566601"} 2023-11-20 08:56:06,601 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=d2702cde56f0dcd71503062a3d396092, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:06,601 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,1,1700470565576.ad7b59ca054cb36c87ef2e1f35f17d22.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1700470566601"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700470566601"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700470566601"}]},"ts":"1700470566601"} 2023-11-20 08:56:06,601 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,2,1700470565576.d2702cde56f0dcd71503062a3d396092.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700470566601"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700470566601"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700470566601"}]},"ts":"1700470566601"} 2023-11-20 08:56:06,603 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=120, ppid=117, state=RUNNABLE; OpenRegionProcedure cc3c29cf22b5437a5aba3278559c21c2, server=jenkins-hbase4.apache.org,38491,1700470412215}] 2023-11-20 08:56:06,603 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=121, ppid=119, state=RUNNABLE; OpenRegionProcedure d2702cde56f0dcd71503062a3d396092, server=jenkins-hbase4.apache.org,38491,1700470412215}] 2023-11-20 08:56:06,604 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=122, ppid=118, state=RUNNABLE; OpenRegionProcedure ad7b59ca054cb36c87ef2e1f35f17d22, server=jenkins-hbase4.apache.org,38491,1700470412215}] 2023-11-20 08:56:06,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-20 08:56:06,754 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:06,757 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,2,1700470565576.d2702cde56f0dcd71503062a3d396092. 2023-11-20 08:56:06,757 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d2702cde56f0dcd71503062a3d396092, NAME => 'testMajorCompactionFromAdmin,2,1700470565576.d2702cde56f0dcd71503062a3d396092.', STARTKEY => '2', ENDKEY => ''} 2023-11-20 08:56:06,757 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin d2702cde56f0dcd71503062a3d396092 2023-11-20 08:56:06,757 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1700470565576.d2702cde56f0dcd71503062a3d396092.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-20 08:56:06,757 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d2702cde56f0dcd71503062a3d396092 2023-11-20 08:56:06,757 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d2702cde56f0dcd71503062a3d396092 2023-11-20 08:56:06,779 INFO [StoreOpener-d2702cde56f0dcd71503062a3d396092-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region d2702cde56f0dcd71503062a3d396092 2023-11-20 08:56:06,780 DEBUG [StoreOpener-d2702cde56f0dcd71503062a3d396092-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/family1 2023-11-20 08:56:06,780 DEBUG [StoreOpener-d2702cde56f0dcd71503062a3d396092-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/family1 2023-11-20 08:56:06,780 INFO [StoreOpener-d2702cde56f0dcd71503062a3d396092-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d2702cde56f0dcd71503062a3d396092 columnFamilyName family1 2023-11-20 08:56:06,782 INFO [StoreOpener-d2702cde56f0dcd71503062a3d396092-1] regionserver.HStore(310): Store=d2702cde56f0dcd71503062a3d396092/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-20 08:56:06,782 INFO [StoreOpener-d2702cde56f0dcd71503062a3d396092-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region d2702cde56f0dcd71503062a3d396092 2023-11-20 08:56:06,783 DEBUG [StoreOpener-d2702cde56f0dcd71503062a3d396092-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/family2 2023-11-20 08:56:06,783 DEBUG [StoreOpener-d2702cde56f0dcd71503062a3d396092-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/family2 2023-11-20 08:56:06,783 INFO [StoreOpener-d2702cde56f0dcd71503062a3d396092-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d2702cde56f0dcd71503062a3d396092 columnFamilyName family2 2023-11-20 08:56:06,784 INFO [StoreOpener-d2702cde56f0dcd71503062a3d396092-1] regionserver.HStore(310): Store=d2702cde56f0dcd71503062a3d396092/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-20 08:56:06,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092 2023-11-20 08:56:06,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092 2023-11-20 08:56:06,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-20 08:56:06,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d2702cde56f0dcd71503062a3d396092 2023-11-20 08:56:06,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-20 08:56:06,789 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d2702cde56f0dcd71503062a3d396092; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59747214, jitterRate=-0.1096971333026886}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-20 08:56:06,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d2702cde56f0dcd71503062a3d396092: 2023-11-20 08:56:06,790 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,2,1700470565576.d2702cde56f0dcd71503062a3d396092., pid=121, masterSystemTime=1700470566754 2023-11-20 08:56:06,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,2,1700470565576.d2702cde56f0dcd71503062a3d396092. 2023-11-20 08:56:06,792 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,2,1700470565576.d2702cde56f0dcd71503062a3d396092. 2023-11-20 08:56:06,792 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,1,1700470565576.ad7b59ca054cb36c87ef2e1f35f17d22. 2023-11-20 08:56:06,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ad7b59ca054cb36c87ef2e1f35f17d22, NAME => 'testMajorCompactionFromAdmin,1,1700470565576.ad7b59ca054cb36c87ef2e1f35f17d22.', STARTKEY => '1', ENDKEY => '2'} 2023-11-20 08:56:06,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin ad7b59ca054cb36c87ef2e1f35f17d22 2023-11-20 08:56:06,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1700470565576.ad7b59ca054cb36c87ef2e1f35f17d22.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-20 08:56:06,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ad7b59ca054cb36c87ef2e1f35f17d22 2023-11-20 08:56:06,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ad7b59ca054cb36c87ef2e1f35f17d22 2023-11-20 08:56:06,792 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=d2702cde56f0dcd71503062a3d396092, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:06,793 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,2,1700470565576.d2702cde56f0dcd71503062a3d396092.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700470566792"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700470566792"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700470566792"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700470566792"}]},"ts":"1700470566792"} 2023-11-20 08:56:06,795 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=121, resume processing ppid=119 2023-11-20 08:56:06,795 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=121, ppid=119, state=SUCCESS; OpenRegionProcedure d2702cde56f0dcd71503062a3d396092, server=jenkins-hbase4.apache.org,38491,1700470412215 in 191 msec 2023-11-20 08:56:06,796 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=119, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=d2702cde56f0dcd71503062a3d396092, ASSIGN in 348 msec 2023-11-20 08:56:06,818 INFO [StoreOpener-ad7b59ca054cb36c87ef2e1f35f17d22-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region ad7b59ca054cb36c87ef2e1f35f17d22 2023-11-20 08:56:06,819 DEBUG [StoreOpener-ad7b59ca054cb36c87ef2e1f35f17d22-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/family1 2023-11-20 08:56:06,819 DEBUG [StoreOpener-ad7b59ca054cb36c87ef2e1f35f17d22-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/family1 2023-11-20 08:56:06,819 INFO [StoreOpener-ad7b59ca054cb36c87ef2e1f35f17d22-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ad7b59ca054cb36c87ef2e1f35f17d22 columnFamilyName family1 2023-11-20 08:56:06,820 INFO [StoreOpener-ad7b59ca054cb36c87ef2e1f35f17d22-1] regionserver.HStore(310): Store=ad7b59ca054cb36c87ef2e1f35f17d22/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-20 08:56:06,820 INFO [StoreOpener-ad7b59ca054cb36c87ef2e1f35f17d22-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region ad7b59ca054cb36c87ef2e1f35f17d22 2023-11-20 08:56:06,821 DEBUG [StoreOpener-ad7b59ca054cb36c87ef2e1f35f17d22-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/family2 2023-11-20 08:56:06,821 DEBUG [StoreOpener-ad7b59ca054cb36c87ef2e1f35f17d22-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/family2 2023-11-20 08:56:06,821 INFO [StoreOpener-ad7b59ca054cb36c87ef2e1f35f17d22-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ad7b59ca054cb36c87ef2e1f35f17d22 columnFamilyName family2 2023-11-20 08:56:06,822 INFO [StoreOpener-ad7b59ca054cb36c87ef2e1f35f17d22-1] regionserver.HStore(310): Store=ad7b59ca054cb36c87ef2e1f35f17d22/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-20 08:56:06,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22 2023-11-20 08:56:06,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22 2023-11-20 08:56:06,824 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-20 08:56:06,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ad7b59ca054cb36c87ef2e1f35f17d22 2023-11-20 08:56:06,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-20 08:56:06,827 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ad7b59ca054cb36c87ef2e1f35f17d22; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67882131, jitterRate=0.011522576212882996}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-20 08:56:06,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ad7b59ca054cb36c87ef2e1f35f17d22: 2023-11-20 08:56:06,827 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,1,1700470565576.ad7b59ca054cb36c87ef2e1f35f17d22., pid=122, masterSystemTime=1700470566754 2023-11-20 08:56:06,829 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,1,1700470565576.ad7b59ca054cb36c87ef2e1f35f17d22. 2023-11-20 08:56:06,829 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,1,1700470565576.ad7b59ca054cb36c87ef2e1f35f17d22. 2023-11-20 08:56:06,829 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,,1700470565576.cc3c29cf22b5437a5aba3278559c21c2. 2023-11-20 08:56:06,829 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cc3c29cf22b5437a5aba3278559c21c2, NAME => 'testMajorCompactionFromAdmin,,1700470565576.cc3c29cf22b5437a5aba3278559c21c2.', STARTKEY => '', ENDKEY => '1'} 2023-11-20 08:56:06,829 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=ad7b59ca054cb36c87ef2e1f35f17d22, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:06,829 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,1,1700470565576.ad7b59ca054cb36c87ef2e1f35f17d22.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1700470566829"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700470566829"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700470566829"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700470566829"}]},"ts":"1700470566829"} 2023-11-20 08:56:06,829 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin cc3c29cf22b5437a5aba3278559c21c2 2023-11-20 08:56:06,829 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1700470565576.cc3c29cf22b5437a5aba3278559c21c2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-20 08:56:06,829 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for cc3c29cf22b5437a5aba3278559c21c2 2023-11-20 08:56:06,830 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for cc3c29cf22b5437a5aba3278559c21c2 2023-11-20 08:56:06,832 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=122, resume processing ppid=118 2023-11-20 08:56:06,832 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=122, ppid=118, state=SUCCESS; OpenRegionProcedure ad7b59ca054cb36c87ef2e1f35f17d22, server=jenkins-hbase4.apache.org,38491,1700470412215 in 226 msec 2023-11-20 08:56:06,833 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=ad7b59ca054cb36c87ef2e1f35f17d22, ASSIGN in 385 msec 2023-11-20 08:56:06,850 INFO [StoreOpener-cc3c29cf22b5437a5aba3278559c21c2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region cc3c29cf22b5437a5aba3278559c21c2 2023-11-20 08:56:06,851 DEBUG [StoreOpener-cc3c29cf22b5437a5aba3278559c21c2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/family1 2023-11-20 08:56:06,851 DEBUG [StoreOpener-cc3c29cf22b5437a5aba3278559c21c2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/family1 2023-11-20 08:56:06,851 INFO [StoreOpener-cc3c29cf22b5437a5aba3278559c21c2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cc3c29cf22b5437a5aba3278559c21c2 columnFamilyName family1 2023-11-20 08:56:06,852 INFO [StoreOpener-cc3c29cf22b5437a5aba3278559c21c2-1] regionserver.HStore(310): Store=cc3c29cf22b5437a5aba3278559c21c2/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-20 08:56:06,852 INFO [StoreOpener-cc3c29cf22b5437a5aba3278559c21c2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region cc3c29cf22b5437a5aba3278559c21c2 2023-11-20 08:56:06,853 DEBUG [StoreOpener-cc3c29cf22b5437a5aba3278559c21c2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/family2 2023-11-20 08:56:06,853 DEBUG [StoreOpener-cc3c29cf22b5437a5aba3278559c21c2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/family2 2023-11-20 08:56:06,853 INFO [StoreOpener-cc3c29cf22b5437a5aba3278559c21c2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cc3c29cf22b5437a5aba3278559c21c2 columnFamilyName family2 2023-11-20 08:56:06,854 INFO [StoreOpener-cc3c29cf22b5437a5aba3278559c21c2-1] regionserver.HStore(310): Store=cc3c29cf22b5437a5aba3278559c21c2/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-20 08:56:06,855 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2 2023-11-20 08:56:06,855 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2 2023-11-20 08:56:06,856 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-20 08:56:06,857 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for cc3c29cf22b5437a5aba3278559c21c2 2023-11-20 08:56:06,858 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-20 08:56:06,859 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened cc3c29cf22b5437a5aba3278559c21c2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69004399, jitterRate=0.028245672583580017}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-20 08:56:06,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for cc3c29cf22b5437a5aba3278559c21c2: 2023-11-20 08:56:06,859 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,,1700470565576.cc3c29cf22b5437a5aba3278559c21c2., pid=120, masterSystemTime=1700470566754 2023-11-20 08:56:06,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,,1700470565576.cc3c29cf22b5437a5aba3278559c21c2. 2023-11-20 08:56:06,861 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,,1700470565576.cc3c29cf22b5437a5aba3278559c21c2. 2023-11-20 08:56:06,861 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=cc3c29cf22b5437a5aba3278559c21c2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:06,861 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,,1700470565576.cc3c29cf22b5437a5aba3278559c21c2.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700470566861"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700470566861"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700470566861"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700470566861"}]},"ts":"1700470566861"} 2023-11-20 08:56:06,863 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=120, resume processing ppid=117 2023-11-20 08:56:06,863 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=120, ppid=117, state=SUCCESS; OpenRegionProcedure cc3c29cf22b5437a5aba3278559c21c2, server=jenkins-hbase4.apache.org,38491,1700470412215 in 259 msec 2023-11-20 08:56:06,864 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=116 2023-11-20 08:56:06,864 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=cc3c29cf22b5437a5aba3278559c21c2, ASSIGN in 416 msec 2023-11-20 08:56:06,865 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-20 08:56:06,865 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700470566865"}]},"ts":"1700470566865"} 2023-11-20 08:56:06,866 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLED in hbase:meta 2023-11-20 08:56:06,868 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_POST_OPERATION 2023-11-20 08:56:06,869 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=116, state=SUCCESS; CreateTableProcedure table=testMajorCompactionFromAdmin in 1.2620 sec 2023-11-20 08:56:07,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-20 08:56:07,715 INFO [Listener at localhost/43513] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionFromAdmin, procId: 116 completed 2023-11-20 08:56:07,721 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1700470565576.cc3c29cf22b5437a5aba3278559c21c2. with WAL disabled. Data may be lost in the event of a crash. 2023-11-20 08:56:07,722 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1700470565576.ad7b59ca054cb36c87ef2e1f35f17d22. with WAL disabled. Data may be lost in the event of a crash. 2023-11-20 08:56:07,722 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1700470565576.d2702cde56f0dcd71503062a3d396092. with WAL disabled. Data may be lost in the event of a crash. 2023-11-20 08:56:07,724 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:56:07,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-20 08:56:07,725 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-20 08:56:07,725 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:56:07,725 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-20 08:56:07,725 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-20 08:56:07,726 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-20 08:56:07,726 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-20 08:56:07,730 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:56:07,730 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:07,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:56:07,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:56:07,731 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:07,731 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:56:07,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-20 08:56:07,731 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-20 08:56:07,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:56:07,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-20 08:56:07,731 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-20 08:56:07,732 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-20 08:56:07,732 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-20 08:56:07,732 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:56:07,732 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-20 08:56:07,732 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1700470565576.ad7b59ca054cb36c87ef2e1f35f17d22. 2023-11-20 08:56:07,732 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1700470565576.ad7b59ca054cb36c87ef2e1f35f17d22. started... 2023-11-20 08:56:07,732 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-20 08:56:07,732 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:56:07,732 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1700470565576.cc3c29cf22b5437a5aba3278559c21c2. 2023-11-20 08:56:07,733 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ad7b59ca054cb36c87ef2e1f35f17d22 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-20 08:56:07,733 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1700470565576.cc3c29cf22b5437a5aba3278559c21c2. started... 2023-11-20 08:56:07,732 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1700470565576.d2702cde56f0dcd71503062a3d396092. 2023-11-20 08:56:07,733 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1700470565576.d2702cde56f0dcd71503062a3d396092. started... 2023-11-20 08:56:07,733 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing cc3c29cf22b5437a5aba3278559c21c2 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-20 08:56:07,734 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing d2702cde56f0dcd71503062a3d396092 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-20 08:56:07,779 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231120379e1de98c8540a0b7d1a5882b85fecb to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231120379e1de98c8540a0b7d1a5882b85fecb 2023-11-20 08:56:08,188 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023112016755d1eb3074c4e92d9abb5bed8f004 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023112016755d1eb3074c4e92d9abb5bed8f004 2023-11-20 08:56:08,188 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023112018d40be148c94aa984aa36f43437edf2 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023112018d40be148c94aa984aa36f43437edf2 2023-11-20 08:56:08,194 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/.tmp/family1/a7b0136a24b04ff89c6f629cdaff7707 2023-11-20 08:56:08,209 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/.tmp/family1/16cd577d07de4496a254c3ac83735b94 2023-11-20 08:56:08,225 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311204703fce6f6954319892b1460caf4d2ba to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202311204703fce6f6954319892b1460caf4d2ba 2023-11-20 08:56:08,246 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023112080a75b4a1db04cab80943655ab3db977 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e2023112080a75b4a1db04cab80943655ab3db977 2023-11-20 08:56:08,604 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/.tmp/family1/f8989ece3dad4f2ea9cec584b873276f 2023-11-20 08:56:08,629 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/.tmp/family2/a63ebab0aed1411ca6ebc469ac990dfe 2023-11-20 08:56:08,633 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/.tmp/family1/a7b0136a24b04ff89c6f629cdaff7707 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/family1/a7b0136a24b04ff89c6f629cdaff7707 2023-11-20 08:56:08,637 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023112063c9fef897ff43bf92a049bd4cb97cb2 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b2023112063c9fef897ff43bf92a049bd4cb97cb2 2023-11-20 08:56:08,646 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/.tmp/family2/9eb63771b77547e1be9afa87393c6732 2023-11-20 08:56:08,649 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/.tmp/family1/f8989ece3dad4f2ea9cec584b873276f as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/family1/f8989ece3dad4f2ea9cec584b873276f 2023-11-20 08:56:08,650 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/.tmp/family2/b0b469e156f543139ccf8c1f039f8df4 2023-11-20 08:56:08,654 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/.tmp/family1/16cd577d07de4496a254c3ac83735b94 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/family1/16cd577d07de4496a254c3ac83735b94 2023-11-20 08:56:08,659 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/family1/a7b0136a24b04ff89c6f629cdaff7707, entries=4, sequenceid=5, filesize=5.5 K 2023-11-20 08:56:08,659 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/.tmp/family2/a63ebab0aed1411ca6ebc469ac990dfe as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/family2/a63ebab0aed1411ca6ebc469ac990dfe 2023-11-20 08:56:08,662 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/family2/a63ebab0aed1411ca6ebc469ac990dfe, entries=2, sequenceid=5, filesize=5.1 K 2023-11-20 08:56:08,663 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for d2702cde56f0dcd71503062a3d396092 in 929ms, sequenceid=5, compaction requested=false 2023-11-20 08:56:08,663 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionFromAdmin' 2023-11-20 08:56:08,663 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for d2702cde56f0dcd71503062a3d396092: 2023-11-20 08:56:08,663 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1700470565576.d2702cde56f0dcd71503062a3d396092. 2023-11-20 08:56:08,663 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-20 08:56:08,674 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/family1/f8989ece3dad4f2ea9cec584b873276f, entries=4, sequenceid=5, filesize=5.5 K 2023-11-20 08:56:08,675 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/.tmp/family2/9eb63771b77547e1be9afa87393c6732 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/family2/9eb63771b77547e1be9afa87393c6732 2023-11-20 08:56:08,678 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/family2/9eb63771b77547e1be9afa87393c6732, entries=2, sequenceid=5, filesize=5.1 K 2023-11-20 08:56:08,679 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for ad7b59ca054cb36c87ef2e1f35f17d22 in 946ms, sequenceid=5, compaction requested=false 2023-11-20 08:56:08,679 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ad7b59ca054cb36c87ef2e1f35f17d22: 2023-11-20 08:56:08,680 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1700470565576.ad7b59ca054cb36c87ef2e1f35f17d22. 2023-11-20 08:56:08,680 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-20 08:56:08,689 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/family1/16cd577d07de4496a254c3ac83735b94, entries=4, sequenceid=5, filesize=5.5 K 2023-11-20 08:56:08,690 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/.tmp/family2/b0b469e156f543139ccf8c1f039f8df4 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/family2/b0b469e156f543139ccf8c1f039f8df4 2023-11-20 08:56:08,693 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/family2/b0b469e156f543139ccf8c1f039f8df4, entries=2, sequenceid=5, filesize=5.1 K 2023-11-20 08:56:08,694 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for cc3c29cf22b5437a5aba3278559c21c2 in 961ms, sequenceid=5, compaction requested=false 2023-11-20 08:56:08,694 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for cc3c29cf22b5437a5aba3278559c21c2: 2023-11-20 08:56:08,694 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1700470565576.cc3c29cf22b5437a5aba3278559c21c2. 2023-11-20 08:56:08,694 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-20 08:56:08,694 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-20 08:56:08,694 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:08,694 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-20 08:56:08,694 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-20 08:56:08,696 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:08,696 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-20 08:56:08,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:08,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:56:08,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:56:08,696 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-20 08:56:08,696 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:56:08,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:56:08,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:56:08,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-20 08:56:08,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:08,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:56:08,698 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-20 08:56:08,698 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4f607ead[Count = 0] remaining members to acquire global barrier 2023-11-20 08:56:08,698 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-20 08:56:08,698 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-20 08:56:08,699 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-20 08:56:08,699 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-20 08:56:08,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-20 08:56:08,699 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-20 08:56:08,699 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-20 08:56:08,699 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:08,699 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:56:08,699 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:56:08,701 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-20 08:56:08,701 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:08,701 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:56:08,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:08,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:56:08,701 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-20 08:56:08,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:56:08,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:56:08,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:56:08,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-20 08:56:08,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:08,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:56:08,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-20 08:56:08,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:08,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:56:08,703 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-20 08:56:08,703 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-20 08:56:08,703 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:56:08,703 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:56:08,703 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-20 08:56:08,703 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:56:08,708 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-20 08:56:08,708 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-20 08:56:08,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-20 08:56:08,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-20 08:56:08,709 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:56:08,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-20 08:56:08,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:56:08,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:56:08,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:56:08,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:56:08,709 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:08,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:56:08,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-20 08:56:08,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-20 08:56:08,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:56:08,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-20 08:56:08,710 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:08,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:08,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:56:08,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-20 08:56:08,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:08,712 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:08,712 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:56:08,712 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-20 08:56:08,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:56:08,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:56:08,712 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:56:08,712 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-20 08:56:08,713 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:56:08,712 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:56:08,712 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-20 08:56:08,713 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-11-20 08:56:08,713 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:08,713 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-20 08:56:08,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:56:08,713 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:56:08,713 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-20 08:56:08,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:56:08,713 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-20 08:56:08,713 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-20 08:56:08,813 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:56:08,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:56:08,815 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1700470565576.cc3c29cf22b5437a5aba3278559c21c2. with WAL disabled. Data may be lost in the event of a crash. 2023-11-20 08:56:08,816 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1700470565576.ad7b59ca054cb36c87ef2e1f35f17d22. with WAL disabled. Data may be lost in the event of a crash. 2023-11-20 08:56:08,816 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1700470565576.d2702cde56f0dcd71503062a3d396092. with WAL disabled. Data may be lost in the event of a crash. 2023-11-20 08:56:08,818 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:56:08,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-20 08:56:08,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-20 08:56:08,823 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-20 08:56:08,823 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:56:08,823 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-20 08:56:08,823 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-20 08:56:08,824 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-20 08:56:08,824 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-20 08:56:08,825 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:08,825 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:56:08,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:56:08,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:56:08,826 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:08,826 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:56:08,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-20 08:56:08,826 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-20 08:56:08,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:56:08,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-20 08:56:08,827 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-20 08:56:08,827 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-20 08:56:08,827 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-20 08:56:08,827 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-20 08:56:08,827 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:56:08,827 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-20 08:56:08,827 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1700470565576.ad7b59ca054cb36c87ef2e1f35f17d22. 2023-11-20 08:56:08,827 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-20 08:56:08,827 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:56:08,827 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1700470565576.cc3c29cf22b5437a5aba3278559c21c2. 2023-11-20 08:56:08,827 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1700470565576.ad7b59ca054cb36c87ef2e1f35f17d22. started... 2023-11-20 08:56:08,827 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1700470565576.d2702cde56f0dcd71503062a3d396092. 2023-11-20 08:56:08,827 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1700470565576.cc3c29cf22b5437a5aba3278559c21c2. started... 2023-11-20 08:56:08,827 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1700470565576.d2702cde56f0dcd71503062a3d396092. started... 2023-11-20 08:56:08,827 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ad7b59ca054cb36c87ef2e1f35f17d22 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-20 08:56:08,828 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing d2702cde56f0dcd71503062a3d396092 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-20 08:56:08,828 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing cc3c29cf22b5437a5aba3278559c21c2 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-20 08:56:08,889 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311209c5926619d484ccbbdfd1ebf38eed4e6 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311209c5926619d484ccbbdfd1ebf38eed4e6 2023-11-20 08:56:09,281 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231120755ceac47ccd4f6fa9822fcec78b955a to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231120755ceac47ccd4f6fa9822fcec78b955a 2023-11-20 08:56:09,283 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311204e2ef2479daf44e1bfbcc6f6f3ac2a5a to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311204e2ef2479daf44e1bfbcc6f6f3ac2a5a 2023-11-20 08:56:09,302 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/.tmp/family1/b12d462e3acf481892dba489643185be 2023-11-20 08:56:09,311 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/.tmp/family1/72b54cad05b242699edb935b55e26524 2023-11-20 08:56:09,696 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/.tmp/family1/089f5b5411974fe480d815d6fb5384b9 2023-11-20 08:56:09,740 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311200a93ee90b0fe47a2824377c95f8602a8 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202311200a93ee90b0fe47a2824377c95f8602a8 2023-11-20 08:56:09,745 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231120d8c6c55c2c1e46eb9c6d2b04887b2b82 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20231120d8c6c55c2c1e46eb9c6d2b04887b2b82 2023-11-20 08:56:10,129 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231120270918a68d674bf0a04a6299bb2d4bb1 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20231120270918a68d674bf0a04a6299bb2d4bb1 2023-11-20 08:56:10,137 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/.tmp/family2/863f17ee767b4b598f4420414370a886 2023-11-20 08:56:10,141 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/.tmp/family1/089f5b5411974fe480d815d6fb5384b9 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/family1/089f5b5411974fe480d815d6fb5384b9 2023-11-20 08:56:10,144 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/.tmp/family2/1cce1220c4f547cb8932e64d5d310862 2023-11-20 08:56:10,148 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/.tmp/family1/b12d462e3acf481892dba489643185be as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/family1/b12d462e3acf481892dba489643185be 2023-11-20 08:56:10,150 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/.tmp/family2/e9f02bd31d29430880da2de211f294d6 2023-11-20 08:56:10,153 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/.tmp/family1/72b54cad05b242699edb935b55e26524 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/family1/72b54cad05b242699edb935b55e26524 2023-11-20 08:56:10,165 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/family1/089f5b5411974fe480d815d6fb5384b9, entries=4, sequenceid=9, filesize=5.5 K 2023-11-20 08:56:10,166 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/.tmp/family2/863f17ee767b4b598f4420414370a886 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/family2/863f17ee767b4b598f4420414370a886 2023-11-20 08:56:10,169 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/family2/863f17ee767b4b598f4420414370a886, entries=2, sequenceid=9, filesize=5.1 K 2023-11-20 08:56:10,170 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for ad7b59ca054cb36c87ef2e1f35f17d22 in 1343ms, sequenceid=9, compaction requested=false 2023-11-20 08:56:10,170 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ad7b59ca054cb36c87ef2e1f35f17d22: 2023-11-20 08:56:10,170 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1700470565576.ad7b59ca054cb36c87ef2e1f35f17d22. 2023-11-20 08:56:10,170 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-20 08:56:10,170 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/family1/b12d462e3acf481892dba489643185be, entries=4, sequenceid=9, filesize=5.5 K 2023-11-20 08:56:10,171 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/.tmp/family2/1cce1220c4f547cb8932e64d5d310862 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/family2/1cce1220c4f547cb8932e64d5d310862 2023-11-20 08:56:10,174 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/family2/1cce1220c4f547cb8932e64d5d310862, entries=2, sequenceid=9, filesize=5.1 K 2023-11-20 08:56:10,174 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for cc3c29cf22b5437a5aba3278559c21c2 in 1347ms, sequenceid=9, compaction requested=false 2023-11-20 08:56:10,174 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for cc3c29cf22b5437a5aba3278559c21c2: 2023-11-20 08:56:10,175 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1700470565576.cc3c29cf22b5437a5aba3278559c21c2. 2023-11-20 08:56:10,175 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-20 08:56:10,176 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/family1/72b54cad05b242699edb935b55e26524, entries=4, sequenceid=9, filesize=5.5 K 2023-11-20 08:56:10,177 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/.tmp/family2/e9f02bd31d29430880da2de211f294d6 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/family2/e9f02bd31d29430880da2de211f294d6 2023-11-20 08:56:10,179 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/family2/e9f02bd31d29430880da2de211f294d6, entries=2, sequenceid=9, filesize=5.1 K 2023-11-20 08:56:10,180 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for d2702cde56f0dcd71503062a3d396092 in 1352ms, sequenceid=9, compaction requested=false 2023-11-20 08:56:10,180 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for d2702cde56f0dcd71503062a3d396092: 2023-11-20 08:56:10,180 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1700470565576.d2702cde56f0dcd71503062a3d396092. 2023-11-20 08:56:10,180 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-20 08:56:10,180 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-20 08:56:10,180 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:10,180 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-20 08:56:10,180 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-20 08:56:10,183 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:10,183 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-20 08:56:10,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:10,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:56:10,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:56:10,184 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-20 08:56:10,184 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:56:10,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:56:10,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:56:10,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-20 08:56:10,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:10,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:56:10,185 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-20 08:56:10,185 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@42e3a551[Count = 0] remaining members to acquire global barrier 2023-11-20 08:56:10,185 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-20 08:56:10,185 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-20 08:56:10,186 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-20 08:56:10,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-20 08:56:10,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-20 08:56:10,186 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-20 08:56:10,186 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-20 08:56:10,186 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:56:10,187 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:10,187 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:56:10,188 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-20 08:56:10,188 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:56:10,188 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:10,188 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-20 08:56:10,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:10,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:56:10,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:56:10,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:56:10,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:56:10,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-20 08:56:10,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:10,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:56:10,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-20 08:56:10,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:10,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:56:10,190 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-20 08:56:10,190 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-20 08:56:10,190 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:56:10,190 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:56:10,190 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-20 08:56:10,190 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:56:10,192 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-20 08:56:10,192 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-20 08:56:10,192 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:56:10,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-20 08:56:10,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-20 08:56:10,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-20 08:56:10,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:56:10,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:56:10,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:56:10,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:56:10,193 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:10,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:56:10,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-20 08:56:10,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-20 08:56:10,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:56:10,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-20 08:56:10,194 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:10,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:10,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:56:10,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-20 08:56:10,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:10,198 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:10,198 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-20 08:56:10,198 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:56:10,198 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-11-20 08:56:10,198 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:56:10,198 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-20 08:56:10,198 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:56:10,198 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-20 08:56:10,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:56:10,198 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:56:10,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:56:10,198 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:10,199 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-20 08:56:10,199 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-20 08:56:10,199 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:56:10,199 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-20 08:56:10,199 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-20 08:56:10,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:56:10,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:56:10,299 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:56:10,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:56:10,301 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1700470565576.cc3c29cf22b5437a5aba3278559c21c2. with WAL disabled. Data may be lost in the event of a crash. 2023-11-20 08:56:10,301 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1700470565576.ad7b59ca054cb36c87ef2e1f35f17d22. with WAL disabled. Data may be lost in the event of a crash. 2023-11-20 08:56:10,301 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1700470565576.d2702cde56f0dcd71503062a3d396092. with WAL disabled. Data may be lost in the event of a crash. 2023-11-20 08:56:10,303 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:56:10,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-20 08:56:10,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-20 08:56:10,305 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-20 08:56:10,305 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:56:10,305 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-20 08:56:10,305 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-20 08:56:10,305 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-20 08:56:10,306 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-20 08:56:10,307 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:10,307 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:56:10,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:56:10,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:56:10,307 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:10,307 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:56:10,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-20 08:56:10,308 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-20 08:56:10,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:56:10,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-20 08:56:10,308 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-20 08:56:10,308 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-20 08:56:10,308 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-20 08:56:10,308 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-20 08:56:10,308 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:56:10,309 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-20 08:56:10,309 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1700470565576.ad7b59ca054cb36c87ef2e1f35f17d22. 2023-11-20 08:56:10,309 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1700470565576.ad7b59ca054cb36c87ef2e1f35f17d22. started... 2023-11-20 08:56:10,309 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-20 08:56:10,309 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ad7b59ca054cb36c87ef2e1f35f17d22 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-20 08:56:10,309 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1700470565576.cc3c29cf22b5437a5aba3278559c21c2. 2023-11-20 08:56:10,309 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1700470565576.cc3c29cf22b5437a5aba3278559c21c2. started... 2023-11-20 08:56:10,309 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1700470565576.d2702cde56f0dcd71503062a3d396092. 2023-11-20 08:56:10,309 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1700470565576.d2702cde56f0dcd71503062a3d396092. started... 2023-11-20 08:56:10,309 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:56:10,309 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing d2702cde56f0dcd71503062a3d396092 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-20 08:56:10,309 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing cc3c29cf22b5437a5aba3278559c21c2 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-20 08:56:10,353 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231120d064328614614c5aacee51a1abcc6d0d to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231120d064328614614c5aacee51a1abcc6d0d 2023-11-20 08:56:10,358 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231120727ce50ef8e44cfa8f81ac9264f2d27f to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231120727ce50ef8e44cfa8f81ac9264f2d27f 2023-11-20 08:56:10,367 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/.tmp/family1/3c59b63c40b844c08dd975eefb2c91ed 2023-11-20 08:56:10,750 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231120a59e4fe50b464a97bb57d2609e5fe0b0 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231120a59e4fe50b464a97bb57d2609e5fe0b0 2023-11-20 08:56:10,764 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/.tmp/family1/8679da8cf8924854bbdd19e3a9a752e6 2023-11-20 08:56:10,773 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/.tmp/family1/06831192009e4a08a14b3e8dc09ff453 2023-11-20 08:56:10,798 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231120132f4893491e44d2ba7484627707df06 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20231120132f4893491e44d2ba7484627707df06 2023-11-20 08:56:10,812 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311203a2438ed3e74406b97e52487eed25029 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202311203a2438ed3e74406b97e52487eed25029 2023-11-20 08:56:10,816 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/.tmp/family2/0dc6ff70f6ef46cabe935f53886d7b2c 2023-11-20 08:56:10,819 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/.tmp/family1/06831192009e4a08a14b3e8dc09ff453 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/family1/06831192009e4a08a14b3e8dc09ff453 2023-11-20 08:56:10,850 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/family1/06831192009e4a08a14b3e8dc09ff453, entries=4, sequenceid=13, filesize=5.5 K 2023-11-20 08:56:10,851 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/.tmp/family2/0dc6ff70f6ef46cabe935f53886d7b2c as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/family2/0dc6ff70f6ef46cabe935f53886d7b2c 2023-11-20 08:56:10,854 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/family2/0dc6ff70f6ef46cabe935f53886d7b2c, entries=2, sequenceid=13, filesize=5.1 K 2023-11-20 08:56:10,855 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for cc3c29cf22b5437a5aba3278559c21c2 in 546ms, sequenceid=13, compaction requested=true 2023-11-20 08:56:10,855 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for cc3c29cf22b5437a5aba3278559c21c2: 2023-11-20 08:56:10,855 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1700470565576.cc3c29cf22b5437a5aba3278559c21c2. 2023-11-20 08:56:10,855 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-20 08:56:11,201 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023112078bee2c771094e0ba00a77bd4b79775a to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c2023112078bee2c771094e0ba00a77bd4b79775a 2023-11-20 08:56:11,206 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/.tmp/family2/f57b5308308345b9a03a700dc69b0aa2 2023-11-20 08:56:11,206 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/.tmp/family2/2bd3f3c1ca154ccdb32f545eb6405511 2023-11-20 08:56:11,210 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/.tmp/family1/8679da8cf8924854bbdd19e3a9a752e6 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/family1/8679da8cf8924854bbdd19e3a9a752e6 2023-11-20 08:56:11,210 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/.tmp/family1/3c59b63c40b844c08dd975eefb2c91ed as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/family1/3c59b63c40b844c08dd975eefb2c91ed 2023-11-20 08:56:11,233 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/family1/3c59b63c40b844c08dd975eefb2c91ed, entries=4, sequenceid=13, filesize=5.5 K 2023-11-20 08:56:11,233 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/family1/8679da8cf8924854bbdd19e3a9a752e6, entries=4, sequenceid=13, filesize=5.5 K 2023-11-20 08:56:11,234 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/.tmp/family2/2bd3f3c1ca154ccdb32f545eb6405511 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/family2/2bd3f3c1ca154ccdb32f545eb6405511 2023-11-20 08:56:11,234 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/.tmp/family2/f57b5308308345b9a03a700dc69b0aa2 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/family2/f57b5308308345b9a03a700dc69b0aa2 2023-11-20 08:56:11,237 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/family2/2bd3f3c1ca154ccdb32f545eb6405511, entries=2, sequenceid=13, filesize=5.1 K 2023-11-20 08:56:11,237 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/family2/f57b5308308345b9a03a700dc69b0aa2, entries=2, sequenceid=13, filesize=5.1 K 2023-11-20 08:56:11,238 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for ad7b59ca054cb36c87ef2e1f35f17d22 in 929ms, sequenceid=13, compaction requested=true 2023-11-20 08:56:11,238 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for d2702cde56f0dcd71503062a3d396092 in 929ms, sequenceid=13, compaction requested=true 2023-11-20 08:56:11,238 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ad7b59ca054cb36c87ef2e1f35f17d22: 2023-11-20 08:56:11,238 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for d2702cde56f0dcd71503062a3d396092: 2023-11-20 08:56:11,238 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1700470565576.ad7b59ca054cb36c87ef2e1f35f17d22. 2023-11-20 08:56:11,238 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1700470565576.d2702cde56f0dcd71503062a3d396092. 2023-11-20 08:56:11,238 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-20 08:56:11,238 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-20 08:56:11,238 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-20 08:56:11,238 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:11,238 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-20 08:56:11,238 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-20 08:56:11,240 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:11,240 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-20 08:56:11,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:11,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:56:11,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:56:11,240 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-20 08:56:11,240 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:56:11,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:56:11,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:56:11,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-20 08:56:11,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:11,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:56:11,242 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-20 08:56:11,242 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@67cc4132[Count = 0] remaining members to acquire global barrier 2023-11-20 08:56:11,242 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-20 08:56:11,242 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-20 08:56:11,243 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-20 08:56:11,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-20 08:56:11,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-20 08:56:11,243 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-20 08:56:11,243 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-20 08:56:11,243 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:11,243 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:56:11,243 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:56:11,245 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-20 08:56:11,245 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:11,245 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:56:11,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:11,245 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-20 08:56:11,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:56:11,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:56:11,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:56:11,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:56:11,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-20 08:56:11,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:11,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:56:11,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-20 08:56:11,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:11,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:56:11,247 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-20 08:56:11,247 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-20 08:56:11,247 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:56:11,247 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:56:11,247 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-20 08:56:11,247 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:56:11,249 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-20 08:56:11,249 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-20 08:56:11,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-20 08:56:11,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:56:11,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:56:11,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-20 08:56:11,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-20 08:56:11,249 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:56:11,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:56:11,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:56:11,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:56:11,250 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:11,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-20 08:56:11,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-20 08:56:11,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:56:11,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-20 08:56:11,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:11,251 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:11,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:56:11,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-20 08:56:11,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:11,253 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:11,253 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:56:11,253 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-20 08:56:11,254 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:56:11,254 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:56:11,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:56:11,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:56:11,254 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-20 08:56:11,254 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-20 08:56:11,254 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:56:11,254 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:11,254 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-20 08:56:11,254 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-20 08:56:11,254 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-20 08:56:11,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:56:11,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:56:11,254 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-20 08:56:11,254 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:56:11,354 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:56:11,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:56:11,356 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1700470565576.cc3c29cf22b5437a5aba3278559c21c2. with WAL disabled. Data may be lost in the event of a crash. 2023-11-20 08:56:11,357 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1700470565576.ad7b59ca054cb36c87ef2e1f35f17d22. with WAL disabled. Data may be lost in the event of a crash. 2023-11-20 08:56:11,357 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1700470565576.d2702cde56f0dcd71503062a3d396092. with WAL disabled. Data may be lost in the event of a crash. 2023-11-20 08:56:11,359 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:56:11,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-20 08:56:11,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-20 08:56:11,360 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-20 08:56:11,360 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:56:11,360 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-20 08:56:11,360 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-20 08:56:11,361 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-20 08:56:11,361 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-20 08:56:11,362 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:11,362 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:56:11,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:56:11,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:56:11,363 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:11,363 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:56:11,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-20 08:56:11,363 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-20 08:56:11,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:56:11,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-20 08:56:11,364 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-20 08:56:11,364 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-20 08:56:11,364 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-20 08:56:11,364 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-20 08:56:11,364 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:56:11,364 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-20 08:56:11,364 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1700470565576.ad7b59ca054cb36c87ef2e1f35f17d22. 2023-11-20 08:56:11,364 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1700470565576.cc3c29cf22b5437a5aba3278559c21c2. 2023-11-20 08:56:11,365 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-20 08:56:11,365 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1700470565576.d2702cde56f0dcd71503062a3d396092. 2023-11-20 08:56:11,365 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1700470565576.ad7b59ca054cb36c87ef2e1f35f17d22. started... 2023-11-20 08:56:11,365 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1700470565576.d2702cde56f0dcd71503062a3d396092. started... 2023-11-20 08:56:11,365 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:56:11,365 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1700470565576.cc3c29cf22b5437a5aba3278559c21c2. started... 2023-11-20 08:56:11,365 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ad7b59ca054cb36c87ef2e1f35f17d22 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-20 08:56:11,365 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing d2702cde56f0dcd71503062a3d396092 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-20 08:56:11,365 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing cc3c29cf22b5437a5aba3278559c21c2 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-20 08:56:11,412 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311209bcd265d22904639b1ebdf2aa8df16a6 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311209bcd265d22904639b1ebdf2aa8df16a6 2023-11-20 08:56:11,426 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/.tmp/family1/60ae97a46ee34f21aedb66eca7a1217d 2023-11-20 08:56:11,809 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-20 08:56:11,809 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3bcbd0eb to 127.0.0.1:64635 2023-11-20 08:56:11,809 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-20 08:56:11,809 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-20 08:56:11,809 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x140fb477 to 127.0.0.1:64635 2023-11-20 08:56:11,809 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-20 08:56:11,835 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231120ad47f62fad424eb28be15de4df420fe0 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231120ad47f62fad424eb28be15de4df420fe0 2023-11-20 08:56:11,838 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231120def0f022045447cb93140fdc76704d99 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231120def0f022045447cb93140fdc76704d99 2023-11-20 08:56:11,852 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/.tmp/family1/7ad6b65002be48f0bd10c0ae8c9d6cfc 2023-11-20 08:56:11,855 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231120fa02c799997e41c3845c6b11b46b8ca2 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20231120fa02c799997e41c3845c6b11b46b8ca2 2023-11-20 08:56:11,860 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/.tmp/family2/8367744a15884aa881fe045417b25300 2023-11-20 08:56:11,863 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/.tmp/family1/60ae97a46ee34f21aedb66eca7a1217d as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/family1/60ae97a46ee34f21aedb66eca7a1217d 2023-11-20 08:56:11,882 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231120383249e0083d4358b96776f0d3a45fd7 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20231120383249e0083d4358b96776f0d3a45fd7 2023-11-20 08:56:11,886 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/.tmp/family2/6da87dc1776b47ca9e9ec1be7637277c 2023-11-20 08:56:11,889 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/family1/60ae97a46ee34f21aedb66eca7a1217d, entries=4, sequenceid=17, filesize=5.5 K 2023-11-20 08:56:11,889 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/.tmp/family2/8367744a15884aa881fe045417b25300 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/family2/8367744a15884aa881fe045417b25300 2023-11-20 08:56:11,889 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/.tmp/family1/7ad6b65002be48f0bd10c0ae8c9d6cfc as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/family1/7ad6b65002be48f0bd10c0ae8c9d6cfc 2023-11-20 08:56:11,893 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/family2/8367744a15884aa881fe045417b25300, entries=2, sequenceid=17, filesize=5.1 K 2023-11-20 08:56:11,893 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for ad7b59ca054cb36c87ef2e1f35f17d22 in 528ms, sequenceid=17, compaction requested=true 2023-11-20 08:56:11,894 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ad7b59ca054cb36c87ef2e1f35f17d22: 2023-11-20 08:56:11,894 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1700470565576.ad7b59ca054cb36c87ef2e1f35f17d22. 2023-11-20 08:56:11,894 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-20 08:56:11,913 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/family1/7ad6b65002be48f0bd10c0ae8c9d6cfc, entries=4, sequenceid=17, filesize=5.5 K 2023-11-20 08:56:11,914 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/.tmp/family2/6da87dc1776b47ca9e9ec1be7637277c as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/family2/6da87dc1776b47ca9e9ec1be7637277c 2023-11-20 08:56:11,917 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/family2/6da87dc1776b47ca9e9ec1be7637277c, entries=2, sequenceid=17, filesize=5.1 K 2023-11-20 08:56:11,917 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for d2702cde56f0dcd71503062a3d396092 in 552ms, sequenceid=17, compaction requested=true 2023-11-20 08:56:11,917 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for d2702cde56f0dcd71503062a3d396092: 2023-11-20 08:56:11,917 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1700470565576.d2702cde56f0dcd71503062a3d396092. 2023-11-20 08:56:11,918 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-20 08:56:12,259 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/.tmp/family1/2d892a34d3b3429887de9107ba7d098d 2023-11-20 08:56:12,294 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231120643c21fece3a4578af49f44ecb8c0614 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20231120643c21fece3a4578af49f44ecb8c0614 2023-11-20 08:56:12,319 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-20 08:56:12,698 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/.tmp/family2/66497e9fcabb47f1b722e0e985d2b276 2023-11-20 08:56:12,702 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/.tmp/family1/2d892a34d3b3429887de9107ba7d098d as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/family1/2d892a34d3b3429887de9107ba7d098d 2023-11-20 08:56:12,738 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/family1/2d892a34d3b3429887de9107ba7d098d, entries=4, sequenceid=17, filesize=5.5 K 2023-11-20 08:56:12,739 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/.tmp/family2/66497e9fcabb47f1b722e0e985d2b276 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/family2/66497e9fcabb47f1b722e0e985d2b276 2023-11-20 08:56:12,742 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/family2/66497e9fcabb47f1b722e0e985d2b276, entries=2, sequenceid=17, filesize=5.1 K 2023-11-20 08:56:12,743 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for cc3c29cf22b5437a5aba3278559c21c2 in 1378ms, sequenceid=17, compaction requested=true 2023-11-20 08:56:12,743 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for cc3c29cf22b5437a5aba3278559c21c2: 2023-11-20 08:56:12,743 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1700470565576.cc3c29cf22b5437a5aba3278559c21c2. 2023-11-20 08:56:12,743 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-20 08:56:12,743 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-20 08:56:12,744 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:12,744 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-20 08:56:12,744 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-20 08:56:12,745 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:12,745 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-20 08:56:12,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:12,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:56:12,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:56:12,746 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-20 08:56:12,746 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:56:12,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:56:12,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:56:12,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-20 08:56:12,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:12,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:56:12,747 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-20 08:56:12,747 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1a65965a[Count = 0] remaining members to acquire global barrier 2023-11-20 08:56:12,747 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-20 08:56:12,747 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-20 08:56:12,755 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-20 08:56:12,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-20 08:56:12,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-20 08:56:12,755 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-20 08:56:12,755 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-20 08:56:12,755 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:56:12,755 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:12,756 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:56:12,756 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:12,756 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-20 08:56:12,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:12,757 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:56:12,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:56:12,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:56:12,757 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-20 08:56:12,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:56:12,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:56:12,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-20 08:56:12,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:12,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:56:12,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-20 08:56:12,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:12,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:56:12,759 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-20 08:56:12,759 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-20 08:56:12,759 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:56:12,759 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:56:12,759 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-20 08:56:12,759 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:56:12,761 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-20 08:56:12,761 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-20 08:56:12,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-20 08:56:12,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:56:12,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:56:12,761 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-20 08:56:12,761 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:56:12,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-20 08:56:12,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:56:12,761 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:12,761 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:56:12,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:56:12,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-20 08:56:12,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-20 08:56:12,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:56:12,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-20 08:56:12,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:12,762 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:12,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:56:12,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-20 08:56:12,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:12,765 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:12,765 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-20 08:56:12,765 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:56:12,765 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:56:12,765 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-20 08:56:12,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:56:12,765 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-20 08:56:12,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:56:12,765 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:56:12,765 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:56:12,765 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:12,765 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-20 08:56:12,765 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-20 08:56:12,765 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-20 08:56:12,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:56:12,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:56:12,765 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-20 08:56:12,766 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:56:12,866 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:56:12,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:56:12,877 DEBUG [Listener at localhost/43513] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-20 08:56:12,884 DEBUG [Listener at localhost/43513] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-20 08:56:12,892 DEBUG [Listener at localhost/43513] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-20 08:56:12,893 DEBUG [Listener at localhost/43513] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-20 08:56:12,987 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-20 08:56:12,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-20 08:56:12,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-20 08:56:12,989 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-20 08:56:12,990 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:56:12,990 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-20 08:56:12,990 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-20 08:56:12,990 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-20 08:56:12,990 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-20 08:56:12,992 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:12,992 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:56:12,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:56:12,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:56:12,993 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:12,993 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-20 08:56:12,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-20 08:56:12,993 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-20 08:56:12,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-20 08:56:12,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-20 08:56:12,993 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-20 08:56:12,994 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-20 08:56:12,994 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-20 08:56:12,994 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-20 08:56:12,994 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-20 08:56:12,994 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-20 08:56:12,994 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1700470565576.ad7b59ca054cb36c87ef2e1f35f17d22. 2023-11-20 08:56:12,994 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-20 08:56:12,994 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-20 08:56:12,994 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1700470565576.cc3c29cf22b5437a5aba3278559c21c2. 2023-11-20 08:56:12,994 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1700470565576.d2702cde56f0dcd71503062a3d396092. 2023-11-20 08:56:12,994 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1700470565576.ad7b59ca054cb36c87ef2e1f35f17d22. started... 2023-11-20 08:56:12,994 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1700470565576.d2702cde56f0dcd71503062a3d396092. started... 2023-11-20 08:56:12,994 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1700470565576.cc3c29cf22b5437a5aba3278559c21c2. started... 2023-11-20 08:56:12,994 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ad7b59ca054cb36c87ef2e1f35f17d22 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-20 08:56:12,994 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing cc3c29cf22b5437a5aba3278559c21c2 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-20 08:56:12,994 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing d2702cde56f0dcd71503062a3d396092 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-20 08:56:13,029 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/.tmp/family1/b333215de6cb4c94aff5df9abd9dcffc 2023-11-20 08:56:13,034 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/.tmp/family1/3793b115b901428fbe136112d661c0a2 2023-11-20 08:56:13,051 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b333215de6cb4c94aff5df9abd9dcffc 2023-11-20 08:56:13,059 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3793b115b901428fbe136112d661c0a2 2023-11-20 08:56:13,069 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/.tmp/family2/96d0b746e98a4144aef31d73d88687a5 2023-11-20 08:56:13,073 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/.tmp/family2/9e52dd3734804491bc3303cc1eccb3f6 2023-11-20 08:56:13,073 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 96d0b746e98a4144aef31d73d88687a5 2023-11-20 08:56:13,074 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/.tmp/family1/b333215de6cb4c94aff5df9abd9dcffc as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/family1/b333215de6cb4c94aff5df9abd9dcffc 2023-11-20 08:56:13,077 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9e52dd3734804491bc3303cc1eccb3f6 2023-11-20 08:56:13,078 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/.tmp/family1/3793b115b901428fbe136112d661c0a2 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/family1/3793b115b901428fbe136112d661c0a2 2023-11-20 08:56:13,100 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3793b115b901428fbe136112d661c0a2 2023-11-20 08:56:13,101 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/family1/3793b115b901428fbe136112d661c0a2, entries=3, sequenceid=23, filesize=5.2 K 2023-11-20 08:56:13,101 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/.tmp/family2/9e52dd3734804491bc3303cc1eccb3f6 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/family2/9e52dd3734804491bc3303cc1eccb3f6 2023-11-20 08:56:13,105 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9e52dd3734804491bc3303cc1eccb3f6 2023-11-20 08:56:13,105 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/family2/9e52dd3734804491bc3303cc1eccb3f6, entries=1, sequenceid=23, filesize=5.0 K 2023-11-20 08:56:13,105 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for d2702cde56f0dcd71503062a3d396092 in 111ms, sequenceid=23, compaction requested=true 2023-11-20 08:56:13,105 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for d2702cde56f0dcd71503062a3d396092: 2023-11-20 08:56:13,105 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1700470565576.d2702cde56f0dcd71503062a3d396092. 2023-11-20 08:56:13,106 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-20 08:56:13,108 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b333215de6cb4c94aff5df9abd9dcffc 2023-11-20 08:56:13,108 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/family1/b333215de6cb4c94aff5df9abd9dcffc, entries=3, sequenceid=23, filesize=5.2 K 2023-11-20 08:56:13,108 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/.tmp/family2/96d0b746e98a4144aef31d73d88687a5 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/family2/96d0b746e98a4144aef31d73d88687a5 2023-11-20 08:56:13,113 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 96d0b746e98a4144aef31d73d88687a5 2023-11-20 08:56:13,113 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/family2/96d0b746e98a4144aef31d73d88687a5, entries=1, sequenceid=23, filesize=5.0 K 2023-11-20 08:56:13,114 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for ad7b59ca054cb36c87ef2e1f35f17d22 in 120ms, sequenceid=23, compaction requested=true 2023-11-20 08:56:13,114 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ad7b59ca054cb36c87ef2e1f35f17d22: 2023-11-20 08:56:13,114 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1700470565576.ad7b59ca054cb36c87ef2e1f35f17d22. 2023-11-20 08:56:13,114 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-20 08:56:13,829 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/.tmp/family1/daef2a6547914bd7b35af438a4f802d1 2023-11-20 08:56:13,864 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for daef2a6547914bd7b35af438a4f802d1 2023-11-20 08:56:14,679 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/.tmp/family2/8fb130f466ef4da581849c4a991b386c 2023-11-20 08:56:14,682 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8fb130f466ef4da581849c4a991b386c 2023-11-20 08:56:14,683 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/.tmp/family1/daef2a6547914bd7b35af438a4f802d1 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/family1/daef2a6547914bd7b35af438a4f802d1 2023-11-20 08:56:14,706 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for daef2a6547914bd7b35af438a4f802d1 2023-11-20 08:56:14,706 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/family1/daef2a6547914bd7b35af438a4f802d1, entries=3, sequenceid=23, filesize=5.2 K 2023-11-20 08:56:14,706 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/.tmp/family2/8fb130f466ef4da581849c4a991b386c as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/family2/8fb130f466ef4da581849c4a991b386c 2023-11-20 08:56:14,709 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8fb130f466ef4da581849c4a991b386c 2023-11-20 08:56:14,709 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/family2/8fb130f466ef4da581849c4a991b386c, entries=1, sequenceid=23, filesize=5.0 K 2023-11-20 08:56:14,710 INFO [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for cc3c29cf22b5437a5aba3278559c21c2 in 1716ms, sequenceid=23, compaction requested=true 2023-11-20 08:56:14,710 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for cc3c29cf22b5437a5aba3278559c21c2: 2023-11-20 08:56:14,710 DEBUG [rs(jenkins-hbase4.apache.org,38491,1700470412215)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1700470565576.cc3c29cf22b5437a5aba3278559c21c2. 2023-11-20 08:56:14,710 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-20 08:56:14,710 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-20 08:56:14,710 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:14,711 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-20 08:56:14,711 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-20 08:56:14,712 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-20 08:56:14,712 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:14,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:14,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:56:14,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:56:14,712 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-20 08:56:14,712 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-20 08:56:14,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:56:14,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:56:14,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-20 08:56:14,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:14,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:56:14,714 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38491,1700470412215' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-20 08:56:14,714 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@56bc06ad[Count = 0] remaining members to acquire global barrier 2023-11-20 08:56:14,714 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-20 08:56:14,714 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-20 08:56:14,715 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-20 08:56:14,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-20 08:56:14,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-20 08:56:14,715 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-20 08:56:14,715 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-20 08:56:14,715 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,38491,1700470412215' in zk 2023-11-20 08:56:14,715 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:14,715 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-20 08:56:14,716 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-20 08:56:14,716 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:14,716 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:56:14,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:14,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:56:14,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:56:14,716 DEBUG [member: 'jenkins-hbase4.apache.org,38491,1700470412215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-20 08:56:14,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:56:14,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:56:14,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-20 08:56:14,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:14,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:56:14,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-20 08:56:14,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:14,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,38491,1700470412215': 2023-11-20 08:56:14,719 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38491,1700470412215' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-20 08:56:14,719 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-20 08:56:14,719 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-20 08:56:14,719 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-20 08:56:14,719 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-20 08:56:14,719 INFO [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-20 08:56:14,722 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-20 08:56:14,722 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:56:14,722 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-20 08:56:14,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-20 08:56:14,722 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-20 08:56:14,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-20 08:56:14,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-20 08:56:14,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-20 08:56:14,722 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:56:14,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:56:14,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-20 08:56:14,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-20 08:56:14,724 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:14,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-20 08:56:14,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-20 08:56:14,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-20 08:56:14,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:14,726 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:14,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-20 08:56:14,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-20 08:56:14,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:14,728 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:14,728 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-20 08:56:14,728 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-20 08:56:14,728 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-20 08:56:14,728 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:14,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-20 08:56:14,729 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-20 08:56:14,729 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-20 08:56:14,729 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-20 08:56:14,729 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-20 08:56:14,729 DEBUG [(jenkins-hbase4.apache.org,36169,1700470410986)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-20 08:56:14,729 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-20 08:56:14,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-20 08:56:14,729 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-20 08:56:14,729 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-20 08:56:14,729 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-20 08:56:14,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-20 08:56:14,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-20 08:56:14,829 DEBUG [Listener at localhost/43513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-20 08:56:14,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36169] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-20 08:56:14,831 DEBUG [Listener at localhost/43513] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-20 08:56:14,831 DEBUG [Listener at localhost/43513] regionserver.HStore(1912): ad7b59ca054cb36c87ef2e1f35f17d22/family1 is initiating major compaction (all files) 2023-11-20 08:56:14,831 INFO [Listener at localhost/43513] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-20 08:56:14,831 INFO [Listener at localhost/43513] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-20 08:56:14,831 INFO [Listener at localhost/43513] regionserver.HRegion(2259): Starting compaction of ad7b59ca054cb36c87ef2e1f35f17d22/family1 in testMajorCompactionFromAdmin,1,1700470565576.ad7b59ca054cb36c87ef2e1f35f17d22. 2023-11-20 08:56:14,832 INFO [Listener at localhost/43513] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/family1/f8989ece3dad4f2ea9cec584b873276f, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/family1/089f5b5411974fe480d815d6fb5384b9, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/family1/3c59b63c40b844c08dd975eefb2c91ed, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/family1/60ae97a46ee34f21aedb66eca7a1217d, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/family1/b333215de6cb4c94aff5df9abd9dcffc] into tmpdir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/.tmp, totalSize=27.1 K 2023-11-20 08:56:14,832 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting f8989ece3dad4f2ea9cec584b873276f, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700470567722 2023-11-20 08:56:14,833 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting 089f5b5411974fe480d815d6fb5384b9, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700470568816 2023-11-20 08:56:14,833 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting 3c59b63c40b844c08dd975eefb2c91ed, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700470570301 2023-11-20 08:56:14,833 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting 60ae97a46ee34f21aedb66eca7a1217d, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700470571356 2023-11-20 08:56:14,834 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting b333215de6cb4c94aff5df9abd9dcffc, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-20 08:56:14,843 INFO [Listener at localhost/43513] throttle.PressureAwareThroughputController(145): ad7b59ca054cb36c87ef2e1f35f17d22#family1#compaction#197 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-20 08:56:15,281 INFO [Listener at localhost/43513] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231120f5a46746a05f40cea2c1c720c4b39eb9_del 2023-11-20 08:56:15,282 INFO [Listener at localhost/43513] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231120f5a46746a05f40cea2c1c720c4b39eb9_del to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231120f5a46746a05f40cea2c1c720c4b39eb9_del 2023-11-20 08:56:15,732 INFO [Listener at localhost/43513] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 34dbcda04a744fbcaba865bec61da44e 2023-11-20 08:56:15,733 DEBUG [Listener at localhost/43513] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/.tmp/family1/34dbcda04a744fbcaba865bec61da44e as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/family1/34dbcda04a744fbcaba865bec61da44e 2023-11-20 08:56:15,754 INFO [Listener at localhost/43513] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 34dbcda04a744fbcaba865bec61da44e 2023-11-20 08:56:15,756 INFO [Listener at localhost/43513] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in ad7b59ca054cb36c87ef2e1f35f17d22/family1 of ad7b59ca054cb36c87ef2e1f35f17d22 into 34dbcda04a744fbcaba865bec61da44e(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-20 08:56:15,756 DEBUG [Listener at localhost/43513] regionserver.HRegion(2289): Compaction status journal for ad7b59ca054cb36c87ef2e1f35f17d22: 2023-11-20 08:56:15,756 DEBUG [Listener at localhost/43513] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-20 08:56:15,756 DEBUG [Listener at localhost/43513] regionserver.HStore(1912): ad7b59ca054cb36c87ef2e1f35f17d22/family2 is initiating major compaction (all files) 2023-11-20 08:56:15,756 INFO [Listener at localhost/43513] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-20 08:56:15,756 INFO [Listener at localhost/43513] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-20 08:56:15,756 INFO [Listener at localhost/43513] regionserver.HRegion(2259): Starting compaction of ad7b59ca054cb36c87ef2e1f35f17d22/family2 in testMajorCompactionFromAdmin,1,1700470565576.ad7b59ca054cb36c87ef2e1f35f17d22. 2023-11-20 08:56:15,757 INFO [Listener at localhost/43513] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/family2/9eb63771b77547e1be9afa87393c6732, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/family2/863f17ee767b4b598f4420414370a886, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/family2/2bd3f3c1ca154ccdb32f545eb6405511, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/family2/8367744a15884aa881fe045417b25300, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/family2/96d0b746e98a4144aef31d73d88687a5] into tmpdir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/.tmp, totalSize=25.4 K 2023-11-20 08:56:15,757 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting 9eb63771b77547e1be9afa87393c6732, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700470567722 2023-11-20 08:56:15,758 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting 863f17ee767b4b598f4420414370a886, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700470568816 2023-11-20 08:56:15,758 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting 2bd3f3c1ca154ccdb32f545eb6405511, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700470570301 2023-11-20 08:56:15,758 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting 8367744a15884aa881fe045417b25300, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700470571356 2023-11-20 08:56:15,759 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting 96d0b746e98a4144aef31d73d88687a5, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-20 08:56:15,774 INFO [Listener at localhost/43513] throttle.PressureAwareThroughputController(145): ad7b59ca054cb36c87ef2e1f35f17d22#family2#compaction#198 average throughput is 0.12 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-20 08:56:15,829 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/family1/f8989ece3dad4f2ea9cec584b873276f, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/family1/089f5b5411974fe480d815d6fb5384b9, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/family1/3c59b63c40b844c08dd975eefb2c91ed, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/family1/60ae97a46ee34f21aedb66eca7a1217d, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/family1/b333215de6cb4c94aff5df9abd9dcffc] to archive 2023-11-20 08:56:15,830 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:56:15,831 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/family1/f8989ece3dad4f2ea9cec584b873276f to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/family1/f8989ece3dad4f2ea9cec584b873276f 2023-11-20 08:56:15,832 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/family1/089f5b5411974fe480d815d6fb5384b9 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/family1/089f5b5411974fe480d815d6fb5384b9 2023-11-20 08:56:15,833 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/family1/3c59b63c40b844c08dd975eefb2c91ed to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/family1/3c59b63c40b844c08dd975eefb2c91ed 2023-11-20 08:56:15,834 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/family1/60ae97a46ee34f21aedb66eca7a1217d to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/family1/60ae97a46ee34f21aedb66eca7a1217d 2023-11-20 08:56:15,835 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/family1/b333215de6cb4c94aff5df9abd9dcffc to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/family1/b333215de6cb4c94aff5df9abd9dcffc 2023-11-20 08:56:16,182 INFO [Listener at localhost/43513] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231120208331d948074752ae114265340d3271_del 2023-11-20 08:56:16,182 INFO [Listener at localhost/43513] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231120208331d948074752ae114265340d3271_del to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20231120208331d948074752ae114265340d3271_del 2023-11-20 08:56:16,993 INFO [Listener at localhost/43513] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1c968128d7e2408e88615080ac70f23d 2023-11-20 08:56:16,994 DEBUG [Listener at localhost/43513] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/.tmp/family2/1c968128d7e2408e88615080ac70f23d as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/family2/1c968128d7e2408e88615080ac70f23d 2023-11-20 08:56:16,997 INFO [Listener at localhost/43513] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1c968128d7e2408e88615080ac70f23d 2023-11-20 08:56:16,998 INFO [Listener at localhost/43513] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in ad7b59ca054cb36c87ef2e1f35f17d22/family2 of ad7b59ca054cb36c87ef2e1f35f17d22 into 1c968128d7e2408e88615080ac70f23d(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-20 08:56:16,998 DEBUG [Listener at localhost/43513] regionserver.HRegion(2289): Compaction status journal for ad7b59ca054cb36c87ef2e1f35f17d22: 2023-11-20 08:56:16,998 DEBUG [Listener at localhost/43513] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-20 08:56:16,998 DEBUG [Listener at localhost/43513] regionserver.HStore(1912): cc3c29cf22b5437a5aba3278559c21c2/family1 is initiating major compaction (all files) 2023-11-20 08:56:16,998 INFO [Listener at localhost/43513] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-20 08:56:16,998 INFO [Listener at localhost/43513] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-20 08:56:17,000 INFO [Listener at localhost/43513] regionserver.HRegion(2259): Starting compaction of cc3c29cf22b5437a5aba3278559c21c2/family1 in testMajorCompactionFromAdmin,,1700470565576.cc3c29cf22b5437a5aba3278559c21c2. 2023-11-20 08:56:17,000 INFO [Listener at localhost/43513] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/family1/16cd577d07de4496a254c3ac83735b94, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/family1/b12d462e3acf481892dba489643185be, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/family1/06831192009e4a08a14b3e8dc09ff453, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/family1/2d892a34d3b3429887de9107ba7d098d, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/family1/daef2a6547914bd7b35af438a4f802d1] into tmpdir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/.tmp, totalSize=27.1 K 2023-11-20 08:56:17,000 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting 16cd577d07de4496a254c3ac83735b94, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700470567721 2023-11-20 08:56:17,001 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting b12d462e3acf481892dba489643185be, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700470568815 2023-11-20 08:56:17,001 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting 06831192009e4a08a14b3e8dc09ff453, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700470570301 2023-11-20 08:56:17,001 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting 2d892a34d3b3429887de9107ba7d098d, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700470571356 2023-11-20 08:56:17,001 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting daef2a6547914bd7b35af438a4f802d1, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-20 08:56:17,008 INFO [Listener at localhost/43513] throttle.PressureAwareThroughputController(145): cc3c29cf22b5437a5aba3278559c21c2#family1#compaction#199 average throughput is 1.72 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-20 08:56:17,027 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/family2/9eb63771b77547e1be9afa87393c6732, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/family2/863f17ee767b4b598f4420414370a886, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/family2/2bd3f3c1ca154ccdb32f545eb6405511, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/family2/8367744a15884aa881fe045417b25300, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/family2/96d0b746e98a4144aef31d73d88687a5] to archive 2023-11-20 08:56:17,027 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:56:17,029 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/family2/9eb63771b77547e1be9afa87393c6732 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/family2/9eb63771b77547e1be9afa87393c6732 2023-11-20 08:56:17,030 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/family2/863f17ee767b4b598f4420414370a886 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/family2/863f17ee767b4b598f4420414370a886 2023-11-20 08:56:17,031 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/family2/2bd3f3c1ca154ccdb32f545eb6405511 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/family2/2bd3f3c1ca154ccdb32f545eb6405511 2023-11-20 08:56:17,032 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/family2/8367744a15884aa881fe045417b25300 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/family2/8367744a15884aa881fe045417b25300 2023-11-20 08:56:17,033 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/family2/96d0b746e98a4144aef31d73d88687a5 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/family2/96d0b746e98a4144aef31d73d88687a5 2023-11-20 08:56:17,448 INFO [Listener at localhost/43513] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231120a5f3f4e918b04d73a0700111f900babf_del 2023-11-20 08:56:17,449 INFO [Listener at localhost/43513] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231120a5f3f4e918b04d73a0700111f900babf_del to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231120a5f3f4e918b04d73a0700111f900babf_del 2023-11-20 08:56:18,305 INFO [Listener at localhost/43513] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for aa06af61deb345248f11b45cc6a40a94 2023-11-20 08:56:18,306 DEBUG [Listener at localhost/43513] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/.tmp/family1/aa06af61deb345248f11b45cc6a40a94 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/family1/aa06af61deb345248f11b45cc6a40a94 2023-11-20 08:56:18,328 INFO [Listener at localhost/43513] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for aa06af61deb345248f11b45cc6a40a94 2023-11-20 08:56:18,329 INFO [Listener at localhost/43513] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in cc3c29cf22b5437a5aba3278559c21c2/family1 of cc3c29cf22b5437a5aba3278559c21c2 into aa06af61deb345248f11b45cc6a40a94(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-20 08:56:18,329 DEBUG [Listener at localhost/43513] regionserver.HRegion(2289): Compaction status journal for cc3c29cf22b5437a5aba3278559c21c2: 2023-11-20 08:56:18,329 DEBUG [Listener at localhost/43513] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-20 08:56:18,329 DEBUG [Listener at localhost/43513] regionserver.HStore(1912): cc3c29cf22b5437a5aba3278559c21c2/family2 is initiating major compaction (all files) 2023-11-20 08:56:18,329 INFO [Listener at localhost/43513] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-20 08:56:18,329 INFO [Listener at localhost/43513] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-20 08:56:18,329 INFO [Listener at localhost/43513] regionserver.HRegion(2259): Starting compaction of cc3c29cf22b5437a5aba3278559c21c2/family2 in testMajorCompactionFromAdmin,,1700470565576.cc3c29cf22b5437a5aba3278559c21c2. 2023-11-20 08:56:18,329 INFO [Listener at localhost/43513] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/family2/b0b469e156f543139ccf8c1f039f8df4, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/family2/1cce1220c4f547cb8932e64d5d310862, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/family2/0dc6ff70f6ef46cabe935f53886d7b2c, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/family2/66497e9fcabb47f1b722e0e985d2b276, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/family2/8fb130f466ef4da581849c4a991b386c] into tmpdir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/.tmp, totalSize=25.4 K 2023-11-20 08:56:18,330 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting b0b469e156f543139ccf8c1f039f8df4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700470567721 2023-11-20 08:56:18,330 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting 1cce1220c4f547cb8932e64d5d310862, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700470568815 2023-11-20 08:56:18,330 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting 0dc6ff70f6ef46cabe935f53886d7b2c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700470570301 2023-11-20 08:56:18,330 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting 66497e9fcabb47f1b722e0e985d2b276, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700470571356 2023-11-20 08:56:18,331 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting 8fb130f466ef4da581849c4a991b386c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-20 08:56:18,336 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/family1/16cd577d07de4496a254c3ac83735b94, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/family1/b12d462e3acf481892dba489643185be, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/family1/06831192009e4a08a14b3e8dc09ff453, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/family1/2d892a34d3b3429887de9107ba7d098d, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/family1/daef2a6547914bd7b35af438a4f802d1] to archive 2023-11-20 08:56:18,336 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:56:18,338 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/family1/16cd577d07de4496a254c3ac83735b94 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/family1/16cd577d07de4496a254c3ac83735b94 2023-11-20 08:56:18,339 INFO [Listener at localhost/43513] throttle.PressureAwareThroughputController(145): cc3c29cf22b5437a5aba3278559c21c2#family2#compaction#200 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-20 08:56:18,339 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/family1/b12d462e3acf481892dba489643185be to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/family1/b12d462e3acf481892dba489643185be 2023-11-20 08:56:18,340 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/family1/06831192009e4a08a14b3e8dc09ff453 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/family1/06831192009e4a08a14b3e8dc09ff453 2023-11-20 08:56:18,341 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/family1/2d892a34d3b3429887de9107ba7d098d to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/family1/2d892a34d3b3429887de9107ba7d098d 2023-11-20 08:56:18,342 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/family1/daef2a6547914bd7b35af438a4f802d1 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/family1/daef2a6547914bd7b35af438a4f802d1 2023-11-20 08:56:18,345 INFO [Listener at localhost/43513] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202311201c5ea8b408b1405a9a81c853c2713a31_del 2023-11-20 08:56:18,345 INFO [Listener at localhost/43513] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311201c5ea8b408b1405a9a81c853c2713a31_del to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202311201c5ea8b408b1405a9a81c853c2713a31_del 2023-11-20 08:56:18,757 INFO [Listener at localhost/43513] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1aea93444fde45c1968dabfcad6f5bc4 2023-11-20 08:56:18,758 DEBUG [Listener at localhost/43513] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/.tmp/family2/1aea93444fde45c1968dabfcad6f5bc4 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/family2/1aea93444fde45c1968dabfcad6f5bc4 2023-11-20 08:56:18,761 INFO [Listener at localhost/43513] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1aea93444fde45c1968dabfcad6f5bc4 2023-11-20 08:56:18,762 INFO [Listener at localhost/43513] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in cc3c29cf22b5437a5aba3278559c21c2/family2 of cc3c29cf22b5437a5aba3278559c21c2 into 1aea93444fde45c1968dabfcad6f5bc4(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-20 08:56:18,762 DEBUG [Listener at localhost/43513] regionserver.HRegion(2289): Compaction status journal for cc3c29cf22b5437a5aba3278559c21c2: 2023-11-20 08:56:18,762 DEBUG [Listener at localhost/43513] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-20 08:56:18,762 DEBUG [Listener at localhost/43513] regionserver.HStore(1912): d2702cde56f0dcd71503062a3d396092/family1 is initiating major compaction (all files) 2023-11-20 08:56:18,763 INFO [Listener at localhost/43513] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-20 08:56:18,763 INFO [Listener at localhost/43513] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-20 08:56:18,763 INFO [Listener at localhost/43513] regionserver.HRegion(2259): Starting compaction of d2702cde56f0dcd71503062a3d396092/family1 in testMajorCompactionFromAdmin,2,1700470565576.d2702cde56f0dcd71503062a3d396092. 2023-11-20 08:56:18,763 INFO [Listener at localhost/43513] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/family1/a7b0136a24b04ff89c6f629cdaff7707, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/family1/72b54cad05b242699edb935b55e26524, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/family1/8679da8cf8924854bbdd19e3a9a752e6, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/family1/7ad6b65002be48f0bd10c0ae8c9d6cfc, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/family1/3793b115b901428fbe136112d661c0a2] into tmpdir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/.tmp, totalSize=27.1 K 2023-11-20 08:56:18,763 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting a7b0136a24b04ff89c6f629cdaff7707, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700470567722 2023-11-20 08:56:18,764 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting 72b54cad05b242699edb935b55e26524, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700470568816 2023-11-20 08:56:18,764 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting 8679da8cf8924854bbdd19e3a9a752e6, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700470570301 2023-11-20 08:56:18,765 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting 7ad6b65002be48f0bd10c0ae8c9d6cfc, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700470571357 2023-11-20 08:56:18,765 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting 3793b115b901428fbe136112d661c0a2, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-20 08:56:18,772 INFO [Listener at localhost/43513] throttle.PressureAwareThroughputController(145): d2702cde56f0dcd71503062a3d396092#family1#compaction#201 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-20 08:56:18,826 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/family2/b0b469e156f543139ccf8c1f039f8df4, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/family2/1cce1220c4f547cb8932e64d5d310862, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/family2/0dc6ff70f6ef46cabe935f53886d7b2c, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/family2/66497e9fcabb47f1b722e0e985d2b276, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/family2/8fb130f466ef4da581849c4a991b386c] to archive 2023-11-20 08:56:18,827 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:56:18,829 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/family2/b0b469e156f543139ccf8c1f039f8df4 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/family2/b0b469e156f543139ccf8c1f039f8df4 2023-11-20 08:56:18,830 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/family2/1cce1220c4f547cb8932e64d5d310862 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/family2/1cce1220c4f547cb8932e64d5d310862 2023-11-20 08:56:18,831 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/family2/0dc6ff70f6ef46cabe935f53886d7b2c to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/family2/0dc6ff70f6ef46cabe935f53886d7b2c 2023-11-20 08:56:18,832 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/family2/66497e9fcabb47f1b722e0e985d2b276 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/family2/66497e9fcabb47f1b722e0e985d2b276 2023-11-20 08:56:18,833 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/family2/8fb130f466ef4da581849c4a991b386c to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/family2/8fb130f466ef4da581849c4a991b386c 2023-11-20 08:56:19,218 INFO [Listener at localhost/43513] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202311203074ad4921cb4ba2af46f58e762a520c_del 2023-11-20 08:56:19,218 INFO [Listener at localhost/43513] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311203074ad4921cb4ba2af46f58e762a520c_del to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311203074ad4921cb4ba2af46f58e762a520c_del 2023-11-20 08:56:20,079 INFO [Listener at localhost/43513] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0a0ffe0e70e44734b19e309945131d8b 2023-11-20 08:56:20,079 DEBUG [Listener at localhost/43513] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/.tmp/family1/0a0ffe0e70e44734b19e309945131d8b as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/family1/0a0ffe0e70e44734b19e309945131d8b 2023-11-20 08:56:20,101 INFO [Listener at localhost/43513] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0a0ffe0e70e44734b19e309945131d8b 2023-11-20 08:56:20,102 INFO [Listener at localhost/43513] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in d2702cde56f0dcd71503062a3d396092/family1 of d2702cde56f0dcd71503062a3d396092 into 0a0ffe0e70e44734b19e309945131d8b(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-20 08:56:20,102 DEBUG [Listener at localhost/43513] regionserver.HRegion(2289): Compaction status journal for d2702cde56f0dcd71503062a3d396092: 2023-11-20 08:56:20,102 DEBUG [Listener at localhost/43513] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-20 08:56:20,102 DEBUG [Listener at localhost/43513] regionserver.HStore(1912): d2702cde56f0dcd71503062a3d396092/family2 is initiating major compaction (all files) 2023-11-20 08:56:20,102 INFO [Listener at localhost/43513] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-20 08:56:20,102 INFO [Listener at localhost/43513] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-20 08:56:20,102 INFO [Listener at localhost/43513] regionserver.HRegion(2259): Starting compaction of d2702cde56f0dcd71503062a3d396092/family2 in testMajorCompactionFromAdmin,2,1700470565576.d2702cde56f0dcd71503062a3d396092. 2023-11-20 08:56:20,102 INFO [Listener at localhost/43513] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/family2/a63ebab0aed1411ca6ebc469ac990dfe, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/family2/e9f02bd31d29430880da2de211f294d6, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/family2/f57b5308308345b9a03a700dc69b0aa2, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/family2/6da87dc1776b47ca9e9ec1be7637277c, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/family2/9e52dd3734804491bc3303cc1eccb3f6] into tmpdir=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/.tmp, totalSize=25.4 K 2023-11-20 08:56:20,103 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting a63ebab0aed1411ca6ebc469ac990dfe, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700470567722 2023-11-20 08:56:20,103 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting e9f02bd31d29430880da2de211f294d6, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700470568816 2023-11-20 08:56:20,103 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting f57b5308308345b9a03a700dc69b0aa2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700470570301 2023-11-20 08:56:20,104 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting 6da87dc1776b47ca9e9ec1be7637277c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700470571357 2023-11-20 08:56:20,104 DEBUG [Listener at localhost/43513] compactions.Compactor(207): Compacting 9e52dd3734804491bc3303cc1eccb3f6, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-20 08:56:20,111 INFO [Listener at localhost/43513] throttle.PressureAwareThroughputController(145): d2702cde56f0dcd71503062a3d396092#family2#compaction#202 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-20 08:56:20,127 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/family1/a7b0136a24b04ff89c6f629cdaff7707, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/family1/72b54cad05b242699edb935b55e26524, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/family1/8679da8cf8924854bbdd19e3a9a752e6, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/family1/7ad6b65002be48f0bd10c0ae8c9d6cfc, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/family1/3793b115b901428fbe136112d661c0a2] to archive 2023-11-20 08:56:20,128 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:56:20,129 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/family1/a7b0136a24b04ff89c6f629cdaff7707 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/family1/a7b0136a24b04ff89c6f629cdaff7707 2023-11-20 08:56:20,130 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/family1/72b54cad05b242699edb935b55e26524 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/family1/72b54cad05b242699edb935b55e26524 2023-11-20 08:56:20,131 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/family1/8679da8cf8924854bbdd19e3a9a752e6 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/family1/8679da8cf8924854bbdd19e3a9a752e6 2023-11-20 08:56:20,132 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/family1/7ad6b65002be48f0bd10c0ae8c9d6cfc to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/family1/7ad6b65002be48f0bd10c0ae8c9d6cfc 2023-11-20 08:56:20,133 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/family1/3793b115b901428fbe136112d661c0a2 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/family1/3793b115b901428fbe136112d661c0a2 2023-11-20 08:56:20,519 INFO [Listener at localhost/43513] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231120a5f9685820604857a29361a3d0dc005d_del 2023-11-20 08:56:20,519 INFO [Listener at localhost/43513] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231120a5f9685820604857a29361a3d0dc005d_del to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20231120a5f9685820604857a29361a3d0dc005d_del 2023-11-20 08:56:20,931 INFO [Listener at localhost/43513] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 368d2b3af96140cd86728b1265626fcc 2023-11-20 08:56:20,932 DEBUG [Listener at localhost/43513] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/.tmp/family2/368d2b3af96140cd86728b1265626fcc as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/family2/368d2b3af96140cd86728b1265626fcc 2023-11-20 08:56:20,935 INFO [Listener at localhost/43513] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 368d2b3af96140cd86728b1265626fcc 2023-11-20 08:56:20,935 INFO [Listener at localhost/43513] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in d2702cde56f0dcd71503062a3d396092/family2 of d2702cde56f0dcd71503062a3d396092 into 368d2b3af96140cd86728b1265626fcc(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-20 08:56:20,936 DEBUG [Listener at localhost/43513] regionserver.HRegion(2289): Compaction status journal for d2702cde56f0dcd71503062a3d396092: 2023-11-20 08:56:20,939 DEBUG [Listener at localhost/43513] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-20 08:56:20,942 DEBUG [Listener at localhost/43513] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-20 08:56:20,946 DEBUG [Listener at localhost/43513] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-20 08:56:20,946 DEBUG [Listener at localhost/43513] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-20 08:56:20,951 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=36169] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x9Ex\xC6\xD1\xB8\x84\xEA\x85\xB9\x14\xEF\x84\x15\xF4v\xF5"\x104\x10m\xB3\x90C\xD9\xAC\xA9\xA8\xF1\xBC\xFFOU#*\x10\xBA\xEE|dF\x09\xF4\xE3!\xA8\x02\xF0\xC2H\x14n2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testMajorCompactionFromAdmin 2023-11-20 08:56:20,972 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] procedure2.ProcedureExecutor(1028): Stored pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-11-20 08:56:20,973 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-11-20 08:56:20,973 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-20 08:56:20,973 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=123, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700471180973 2023-11-20 08:56:20,974 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-20 08:56:21,031 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/family2/a63ebab0aed1411ca6ebc469ac990dfe, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/family2/e9f02bd31d29430880da2de211f294d6, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/family2/f57b5308308345b9a03a700dc69b0aa2, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/family2/6da87dc1776b47ca9e9ec1be7637277c, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/family2/9e52dd3734804491bc3303cc1eccb3f6] to archive 2023-11-20 08:56:21,031 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:56:21,033 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/family2/a63ebab0aed1411ca6ebc469ac990dfe to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/family2/a63ebab0aed1411ca6ebc469ac990dfe 2023-11-20 08:56:21,034 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/family2/e9f02bd31d29430880da2de211f294d6 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/family2/e9f02bd31d29430880da2de211f294d6 2023-11-20 08:56:21,035 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/family2/f57b5308308345b9a03a700dc69b0aa2 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/family2/f57b5308308345b9a03a700dc69b0aa2 2023-11-20 08:56:21,037 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/family2/6da87dc1776b47ca9e9ec1be7637277c to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/family2/6da87dc1776b47ca9e9ec1be7637277c 2023-11-20 08:56:21,038 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/family2/9e52dd3734804491bc3303cc1eccb3f6 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/family2/9e52dd3734804491bc3303cc1eccb3f6 2023-11-20 08:56:21,303 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testMajorCompactionFromAdmin' and column 'family1' 2023-11-20 08:56:21,337 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231120a5f3f4e918b04d73a0700111f900babf_del 2023-11-20 08:56:21,360 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231120f5a46746a05f40cea2c1c720c4b39eb9_del 2023-11-20 08:56:21,382 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202311203074ad4921cb4ba2af46f58e762a520c_del 2023-11-20 08:56:21,382 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testMajorCompactionFromAdmin' column='family1' 2023-11-20 08:56:21,383 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] zookeeper.ReadOnlyZKClient(139): Connect 0x2c234a78 to 127.0.0.1:64635 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-20 08:56:21,387 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@64052b8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-20 08:56:21,387 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231120 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-20 08:56:21,947 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231120ca2b5143053b4376954c9084954abed2 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231120ca2b5143053b4376954c9084954abed2 2023-11-20 08:56:21,948 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231120 table='testMajorCompactionFromAdmin' column='family1' 2023-11-20 08:56:21,959 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-20 08:56:21,962 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57110, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-20 08:56:21,971 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-20 08:56:21,973 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59974, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-20 08:56:22,011 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231120/family1/b328bc4b21d547f7880ec79aa475b32f first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-11-20 08:56:22,011 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,2,1700470565576.d2702cde56f0dcd71503062a3d396092., hostname=jenkins-hbase4.apache.org,38491,1700470412215, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231120/family1/b328bc4b21d547f7880ec79aa475b32f}] 2023-11-20 08:56:22,016 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HStore(763): Validating hfile at hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231120/family1/b328bc4b21d547f7880ec79aa475b32f for inclusion in d2702cde56f0dcd71503062a3d396092/family1 2023-11-20 08:56:22,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-11-20 08:56:22,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-20 08:56:22,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HRegion(2446): Flush status journal for d2702cde56f0dcd71503062a3d396092: 2023-11-20 08:56:22,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231120/family1/b328bc4b21d547f7880ec79aa475b32f to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionFromAdmin__1f2v4c3rauj3fuohnhc9nfna6g1mklpa8m020e7a8iq1ntqhqvts3iicpvl1pc0q/family1/b328bc4b21d547f7880ec79aa475b32f 2023-11-20 08:56:22,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionFromAdmin__1f2v4c3rauj3fuohnhc9nfna6g1mklpa8m020e7a8iq1ntqhqvts3iicpvl1pc0q/family1/b328bc4b21d547f7880ec79aa475b32f as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/family1/f251483baaea46ebabfd76e67ccf3ad0_SeqId_28_ 2023-11-20 08:56:22,040 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HStore(849): Loaded HFile hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionFromAdmin__1f2v4c3rauj3fuohnhc9nfna6g1mklpa8m020e7a8iq1ntqhqvts3iicpvl1pc0q/family1/b328bc4b21d547f7880ec79aa475b32f into d2702cde56f0dcd71503062a3d396092/family1 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/family1/f251483baaea46ebabfd76e67ccf3ad0_SeqId_28_ - updating store file list. 2023-11-20 08:56:22,061 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HStore(882): Loaded HFile hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/family1/f251483baaea46ebabfd76e67ccf3ad0_SeqId_28_ into d2702cde56f0dcd71503062a3d396092/family1 2023-11-20 08:56:22,061 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HStore(855): Successfully loaded hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionFromAdmin__1f2v4c3rauj3fuohnhc9nfna6g1mklpa8m020e7a8iq1ntqhqvts3iicpvl1pc0q/family1/b328bc4b21d547f7880ec79aa475b32f into d2702cde56f0dcd71503062a3d396092/family1 (new location: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/family1/f251483baaea46ebabfd76e67ccf3ad0_SeqId_28_) 2023-11-20 08:56:22,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionFromAdmin__1f2v4c3rauj3fuohnhc9nfna6g1mklpa8m020e7a8iq1ntqhqvts3iicpvl1pc0q/family1/b328bc4b21d547f7880ec79aa475b32f 2023-11-20 08:56:22,063 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231120 table='testMajorCompactionFromAdmin' column='family1' 2023-11-20 08:56:22,064 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:56:22,065 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231120379e1de98c8540a0b7d1a5882b85fecb to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231120379e1de98c8540a0b7d1a5882b85fecb 2023-11-20 08:56:22,066 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311209c5926619d484ccbbdfd1ebf38eed4e6 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311209c5926619d484ccbbdfd1ebf38eed4e6 2023-11-20 08:56:22,067 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231120a59e4fe50b464a97bb57d2609e5fe0b0 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231120a59e4fe50b464a97bb57d2609e5fe0b0 2023-11-20 08:56:22,068 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231120ad47f62fad424eb28be15de4df420fe0 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231120ad47f62fad424eb28be15de4df420fe0 2023-11-20 08:56:22,068 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-11-20 08:56:22,068 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231120' 2023-11-20 08:56:22,069 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231120 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-20 08:56:22,069 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231120 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-20 08:56:23,019 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231120a46bc7a8b215490396102cc3c5cad473 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231120a46bc7a8b215490396102cc3c5cad473 2023-11-20 08:56:23,020 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231120 table='testMajorCompactionFromAdmin' column='family1' 2023-11-20 08:56:23,061 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231120/family1/f71c5ff713f0461fb34717a6c1db1a23 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-11-20 08:56:23,062 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,1,1700470565576.ad7b59ca054cb36c87ef2e1f35f17d22., hostname=jenkins-hbase4.apache.org,38491,1700470412215, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231120/family1/f71c5ff713f0461fb34717a6c1db1a23}] 2023-11-20 08:56:23,063 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HStore(763): Validating hfile at hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231120/family1/f71c5ff713f0461fb34717a6c1db1a23 for inclusion in ad7b59ca054cb36c87ef2e1f35f17d22/family1 2023-11-20 08:56:23,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-11-20 08:56:23,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-20 08:56:23,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HRegion(2446): Flush status journal for ad7b59ca054cb36c87ef2e1f35f17d22: 2023-11-20 08:56:23,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231120/family1/f71c5ff713f0461fb34717a6c1db1a23 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionFromAdmin__fkjemrlh19jdsn8a2dv1vvj28oofp6vc99ibp17ogciuknsikbju6pa84njoko4l/family1/f71c5ff713f0461fb34717a6c1db1a23 2023-11-20 08:56:23,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionFromAdmin__fkjemrlh19jdsn8a2dv1vvj28oofp6vc99ibp17ogciuknsikbju6pa84njoko4l/family1/f71c5ff713f0461fb34717a6c1db1a23 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/family1/5d6cb8de6f9a4feeae4e319b12861752_SeqId_28_ 2023-11-20 08:56:23,088 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HStore(849): Loaded HFile hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionFromAdmin__fkjemrlh19jdsn8a2dv1vvj28oofp6vc99ibp17ogciuknsikbju6pa84njoko4l/family1/f71c5ff713f0461fb34717a6c1db1a23 into ad7b59ca054cb36c87ef2e1f35f17d22/family1 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/family1/5d6cb8de6f9a4feeae4e319b12861752_SeqId_28_ - updating store file list. 2023-11-20 08:56:23,110 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HStore(882): Loaded HFile hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/family1/5d6cb8de6f9a4feeae4e319b12861752_SeqId_28_ into ad7b59ca054cb36c87ef2e1f35f17d22/family1 2023-11-20 08:56:23,110 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HStore(855): Successfully loaded hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionFromAdmin__fkjemrlh19jdsn8a2dv1vvj28oofp6vc99ibp17ogciuknsikbju6pa84njoko4l/family1/f71c5ff713f0461fb34717a6c1db1a23 into ad7b59ca054cb36c87ef2e1f35f17d22/family1 (new location: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/family1/5d6cb8de6f9a4feeae4e319b12861752_SeqId_28_) 2023-11-20 08:56:23,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionFromAdmin__fkjemrlh19jdsn8a2dv1vvj28oofp6vc99ibp17ogciuknsikbju6pa84njoko4l/family1/f71c5ff713f0461fb34717a6c1db1a23 2023-11-20 08:56:23,112 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231120 table='testMajorCompactionFromAdmin' column='family1' 2023-11-20 08:56:23,112 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:56:23,114 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023112016755d1eb3074c4e92d9abb5bed8f004 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023112016755d1eb3074c4e92d9abb5bed8f004 2023-11-20 08:56:23,115 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231120755ceac47ccd4f6fa9822fcec78b955a to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231120755ceac47ccd4f6fa9822fcec78b955a 2023-11-20 08:56:23,116 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311209bcd265d22904639b1ebdf2aa8df16a6 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311209bcd265d22904639b1ebdf2aa8df16a6 2023-11-20 08:56:23,117 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231120d064328614614c5aacee51a1abcc6d0d to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231120d064328614614c5aacee51a1abcc6d0d 2023-11-20 08:56:23,117 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-11-20 08:56:23,117 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231120' 2023-11-20 08:56:23,117 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231120 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-20 08:56:23,117 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231120 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-20 08:56:24,066 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231120d7d7d7fdc6ee484e8c33e97a0796a2f6 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231120d7d7d7fdc6ee484e8c33e97a0796a2f6 2023-11-20 08:56:24,066 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231120 table='testMajorCompactionFromAdmin' column='family1' 2023-11-20 08:56:24,107 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231120/family1/922f895909ae4b039f79e3028cd9eac7 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-11-20 08:56:24,108 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,,1700470565576.cc3c29cf22b5437a5aba3278559c21c2., hostname=jenkins-hbase4.apache.org,38491,1700470412215, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231120/family1/922f895909ae4b039f79e3028cd9eac7}] 2023-11-20 08:56:24,109 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HStore(763): Validating hfile at hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231120/family1/922f895909ae4b039f79e3028cd9eac7 for inclusion in cc3c29cf22b5437a5aba3278559c21c2/family1 2023-11-20 08:56:24,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-11-20 08:56:24,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HStore(777): Region bounds: first= last=1 2023-11-20 08:56:24,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HRegion(2446): Flush status journal for cc3c29cf22b5437a5aba3278559c21c2: 2023-11-20 08:56:24,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231120/family1/922f895909ae4b039f79e3028cd9eac7 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionFromAdmin__kktr3cssnhp7l6chv11qid777jm6qpem3117uavsg3j5ub3m1irjrukc477megm4/family1/922f895909ae4b039f79e3028cd9eac7 2023-11-20 08:56:24,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionFromAdmin__kktr3cssnhp7l6chv11qid777jm6qpem3117uavsg3j5ub3m1irjrukc477megm4/family1/922f895909ae4b039f79e3028cd9eac7 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/family1/df47319f00ea4c149e03b32e38bd168a_SeqId_28_ 2023-11-20 08:56:24,134 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HStore(849): Loaded HFile hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionFromAdmin__kktr3cssnhp7l6chv11qid777jm6qpem3117uavsg3j5ub3m1irjrukc477megm4/family1/922f895909ae4b039f79e3028cd9eac7 into cc3c29cf22b5437a5aba3278559c21c2/family1 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/family1/df47319f00ea4c149e03b32e38bd168a_SeqId_28_ - updating store file list. 2023-11-20 08:56:24,155 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HStore(882): Loaded HFile hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/family1/df47319f00ea4c149e03b32e38bd168a_SeqId_28_ into cc3c29cf22b5437a5aba3278559c21c2/family1 2023-11-20 08:56:24,155 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.HStore(855): Successfully loaded hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionFromAdmin__kktr3cssnhp7l6chv11qid777jm6qpem3117uavsg3j5ub3m1irjrukc477megm4/family1/922f895909ae4b039f79e3028cd9eac7 into cc3c29cf22b5437a5aba3278559c21c2/family1 (new location: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/family1/df47319f00ea4c149e03b32e38bd168a_SeqId_28_) 2023-11-20 08:56:24,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38491] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/staging/jenkins__testMajorCompactionFromAdmin__kktr3cssnhp7l6chv11qid777jm6qpem3117uavsg3j5ub3m1irjrukc477megm4/family1/922f895909ae4b039f79e3028cd9eac7 2023-11-20 08:56:24,157 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231120 table='testMajorCompactionFromAdmin' column='family1' 2023-11-20 08:56:24,158 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:56:24,159 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023112018d40be148c94aa984aa36f43437edf2 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023112018d40be148c94aa984aa36f43437edf2 2023-11-20 08:56:24,160 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311204e2ef2479daf44e1bfbcc6f6f3ac2a5a to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311204e2ef2479daf44e1bfbcc6f6f3ac2a5a 2023-11-20 08:56:24,161 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231120727ce50ef8e44cfa8f81ac9264f2d27f to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231120727ce50ef8e44cfa8f81ac9264f2d27f 2023-11-20 08:56:24,162 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231120def0f022045447cb93140fdc76704d99 to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231120def0f022045447cb93140fdc76704d99 2023-11-20 08:56:24,162 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-11-20 08:56:24,162 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231120' 2023-11-20 08:56:24,162 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231120 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-20 08:56:24,162 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testMajorCompactionFromAdmin' column='family1' 2023-11-20 08:56:24,162 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-20 08:56:24,162 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] compactions.PartitionedMobCompactor(367): [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231120a5f3f4e918b04d73a0700111f900babf_del] 2023-11-20 08:56:24,163 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:56:24,164 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231120a5f3f4e918b04d73a0700111f900babf_del to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231120a5f3f4e918b04d73a0700111f900babf_del 2023-11-20 08:56:24,164 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-11-20 08:56:24,164 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] compactions.PartitionedMobCompactor(367): [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231120f5a46746a05f40cea2c1c720c4b39eb9_del] 2023-11-20 08:56:24,164 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:56:24,166 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231120f5a46746a05f40cea2c1c720c4b39eb9_del to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231120f5a46746a05f40cea2c1c720c4b39eb9_del 2023-11-20 08:56:24,166 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-11-20 08:56:24,166 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] compactions.PartitionedMobCompactor(367): [hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311203074ad4921cb4ba2af46f58e762a520c_del] 2023-11-20 08:56:24,166 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] backup.HFileArchiver(360): Archiving compacted files. 2023-11-20 08:56:24,167 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311203074ad4921cb4ba2af46f58e762a520c_del to hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311203074ad4921cb4ba2af46f58e762a520c_del 2023-11-20 08:56:24,167 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-11-20 08:56:24,167 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700470415910] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-20 08:56:24,169 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=123, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-11-20 08:56:24,170 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=123, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE in 3.1980 sec 2023-11-20 08:56:24,183 DEBUG [Listener at localhost/43513] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-20 08:56:24,185 DEBUG [Listener at localhost/43513] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-20 08:56:24,187 DEBUG [Listener at localhost/43513] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-20 08:56:24,187 DEBUG [Listener at localhost/43513] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-20 08:56:24,191 INFO [Listener at localhost/43513] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-20 08:56:24,227 INFO [Listener at localhost/43513] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=249 (was 256), OpenFileDescriptor=666 (was 679), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=112 (was 110) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=15077 (was 15091) 2023-11-20 08:56:24,227 DEBUG [Listener at localhost/43513] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x13bc198c to 127.0.0.1:64635 2023-11-20 08:56:24,228 DEBUG [Listener at localhost/43513] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-20 08:56:24,228 INFO [Listener at localhost/43513] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-11-20 08:56:24,228 INFO [Listener at localhost/43513] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-20 08:56:24,228 DEBUG [Listener at localhost/43513] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4c8d5c2e to 127.0.0.1:64635 2023-11-20 08:56:24,228 DEBUG [Listener at localhost/43513] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-20 08:56:24,229 DEBUG [Listener at localhost/43513] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-11-20 08:56:24,229 DEBUG [Listener at localhost/43513] util.JVMClusterUtil(257): Found active master hash=1082545184, stopped=false 2023-11-20 08:56:24,229 INFO [Listener at localhost/43513] master.ServerManager(888): Cluster shutdown requested of master=jenkins-hbase4.apache.org,36169,1700470410986 2023-11-20 08:56:24,232 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-11-20 08:56:24,232 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-11-20 08:56:24,232 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-20 08:56:24,232 INFO [Listener at localhost/43513] procedure2.ProcedureExecutor(628): Stopping 2023-11-20 08:56:24,232 DEBUG [Listener at localhost/43513] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4002c902 to 127.0.0.1:64635 2023-11-20 08:56:24,232 DEBUG [Listener at localhost/43513] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-20 08:56:24,232 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-20 08:56:24,232 INFO [Listener at localhost/43513] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,38491,1700470412215' ***** 2023-11-20 08:56:24,232 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-20 08:56:24,232 INFO [Listener at localhost/43513] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-11-20 08:56:24,233 INFO [RS:0;jenkins-hbase4:38491] regionserver.HeapMemoryManager(220): Stopping 2023-11-20 08:56:24,233 INFO [RS:0;jenkins-hbase4:38491] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-11-20 08:56:24,233 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-11-20 08:56:24,233 INFO [RS:0;jenkins-hbase4:38491] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-11-20 08:56:24,233 INFO [RS:0;jenkins-hbase4:38491] regionserver.HRegionServer(3305): Received CLOSE for a076e7cbdecd36f051362663494169ac 2023-11-20 08:56:24,234 INFO [RS:0;jenkins-hbase4:38491] regionserver.HRegionServer(3305): Received CLOSE for 85ad044c09ac7e7f46d086f5a2df28bd 2023-11-20 08:56:24,234 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a076e7cbdecd36f051362663494169ac, disabling compactions & flushes 2023-11-20 08:56:24,234 INFO [RS:0;jenkins-hbase4:38491] regionserver.HRegionServer(3305): Received CLOSE for ef901bcc335cc63de4ed78cce9cea920 2023-11-20 08:56:24,234 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1700470427264.a076e7cbdecd36f051362663494169ac. 2023-11-20 08:56:24,234 INFO [RS:0;jenkins-hbase4:38491] regionserver.HRegionServer(3305): Received CLOSE for 7accaa801f4702def28f4caede725b1d 2023-11-20 08:56:24,234 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1700470427264.a076e7cbdecd36f051362663494169ac. 2023-11-20 08:56:24,234 INFO [RS:0;jenkins-hbase4:38491] regionserver.HRegionServer(3305): Received CLOSE for 6f71729b403c1b7661b596f9cabd3e13 2023-11-20 08:56:24,234 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1700470427264.a076e7cbdecd36f051362663494169ac. after waiting 0 ms 2023-11-20 08:56:24,234 INFO [RS:0;jenkins-hbase4:38491] regionserver.HRegionServer(3305): Received CLOSE for c417fce1816d885109d4ed56f4041903 2023-11-20 08:56:24,234 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1700470427264.a076e7cbdecd36f051362663494169ac. 2023-11-20 08:56:24,234 INFO [RS:0;jenkins-hbase4:38491] regionserver.HRegionServer(3305): Received CLOSE for ad7b59ca054cb36c87ef2e1f35f17d22 2023-11-20 08:56:24,235 INFO [RS:0;jenkins-hbase4:38491] regionserver.HRegionServer(3305): Received CLOSE for 32148f74faef43fe3181334f58210602 2023-11-20 08:56:24,235 INFO [RS:0;jenkins-hbase4:38491] regionserver.HRegionServer(3305): Received CLOSE for 559bfeb2e96b535ce0a8d89357bdb240 2023-11-20 08:56:24,235 INFO [RS:0;jenkins-hbase4:38491] regionserver.HRegionServer(3305): Received CLOSE for 3c896a09e2b9659e521fbfa3f4c3a8b7 2023-11-20 08:56:24,235 INFO [RS:0;jenkins-hbase4:38491] regionserver.HRegionServer(3305): Received CLOSE for 612548ffeca5aef6aedcb4899d4e1a66 2023-11-20 08:56:24,235 INFO [RS:0;jenkins-hbase4:38491] regionserver.HRegionServer(3305): Received CLOSE for ebc91fbf023be453f933eaa5806158e2 2023-11-20 08:56:24,235 INFO [RS:0;jenkins-hbase4:38491] regionserver.HRegionServer(3305): Received CLOSE for 1b2f9409842f6bf16f1fa2b0c26e8da7 2023-11-20 08:56:24,235 INFO [RS:0;jenkins-hbase4:38491] regionserver.HRegionServer(3305): Received CLOSE for 7d61965cf9967510cc3eaf24947bb0ef 2023-11-20 08:56:24,235 INFO [RS:0;jenkins-hbase4:38491] regionserver.HRegionServer(3305): Received CLOSE for cc3c29cf22b5437a5aba3278559c21c2 2023-11-20 08:56:24,235 INFO [RS:0;jenkins-hbase4:38491] regionserver.HRegionServer(3305): Received CLOSE for 53dd3cf22f6da76994961de186109db6 2023-11-20 08:56:24,235 INFO [RS:0;jenkins-hbase4:38491] regionserver.HRegionServer(3305): Received CLOSE for 37ddd3693eda6c49fa96f6147c47a803 2023-11-20 08:56:24,235 INFO [RS:0;jenkins-hbase4:38491] regionserver.HRegionServer(3305): Received CLOSE for a4223368d0abcd3a665a863e674f7fce 2023-11-20 08:56:24,235 INFO [RS:0;jenkins-hbase4:38491] regionserver.HRegionServer(3305): Received CLOSE for ca958e54adf0d4e15cf293b5a4212aec 2023-11-20 08:56:24,235 INFO [RS:0;jenkins-hbase4:38491] regionserver.HRegionServer(3305): Received CLOSE for d2702cde56f0dcd71503062a3d396092 2023-11-20 08:56:24,235 INFO [RS:0;jenkins-hbase4:38491] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:24,235 DEBUG [RS:0;jenkins-hbase4:38491] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x72d5a428 to 127.0.0.1:64635 2023-11-20 08:56:24,235 DEBUG [RS:0;jenkins-hbase4:38491] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-20 08:56:24,236 INFO [RS:0;jenkins-hbase4:38491] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-11-20 08:56:24,236 INFO [RS:0;jenkins-hbase4:38491] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-11-20 08:56:24,236 INFO [RS:0;jenkins-hbase4:38491] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-11-20 08:56:24,236 INFO [RS:0;jenkins-hbase4:38491] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-11-20 08:56:24,236 INFO [RS:0;jenkins-hbase4:38491] regionserver.HRegionServer(1474): Waiting on 21 regions to close 2023-11-20 08:56:24,236 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-11-20 08:56:24,236 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-11-20 08:56:24,236 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-11-20 08:56:24,236 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-11-20 08:56:24,236 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-11-20 08:56:24,236 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=50.56 KB heapSize=78.23 KB 2023-11-20 08:56:24,237 DEBUG [RS:0;jenkins-hbase4:38491] regionserver.HRegionServer(1504): Waiting on 1588230740, 1b2f9409842f6bf16f1fa2b0c26e8da7, 32148f74faef43fe3181334f58210602, 37ddd3693eda6c49fa96f6147c47a803, 3c896a09e2b9659e521fbfa3f4c3a8b7, 53dd3cf22f6da76994961de186109db6, 559bfeb2e96b535ce0a8d89357bdb240, 612548ffeca5aef6aedcb4899d4e1a66, 6f71729b403c1b7661b596f9cabd3e13, 7accaa801f4702def28f4caede725b1d, 7d61965cf9967510cc3eaf24947bb0ef, 85ad044c09ac7e7f46d086f5a2df28bd, a076e7cbdecd36f051362663494169ac, a4223368d0abcd3a665a863e674f7fce, ad7b59ca054cb36c87ef2e1f35f17d22, c417fce1816d885109d4ed56f4041903, ca958e54adf0d4e15cf293b5a4212aec, cc3c29cf22b5437a5aba3278559c21c2, d2702cde56f0dcd71503062a3d396092, ebc91fbf023be453f933eaa5806158e2, ef901bcc335cc63de4ed78cce9cea920 2023-11-20 08:56:24,239 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithMonthlyPolicy/a076e7cbdecd36f051362663494169ac/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-11-20 08:56:24,240 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1700470427264.a076e7cbdecd36f051362663494169ac. 2023-11-20 08:56:24,240 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a076e7cbdecd36f051362663494169ac: 2023-11-20 08:56:24,240 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithMonthlyPolicy,,1700470427264.a076e7cbdecd36f051362663494169ac. 2023-11-20 08:56:24,240 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 85ad044c09ac7e7f46d086f5a2df28bd, disabling compactions & flushes 2023-11-20 08:56:24,240 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd. 2023-11-20 08:56:24,240 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd. 2023-11-20 08:56:24,240 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd. after waiting 0 ms 2023-11-20 08:56:24,240 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd. 2023-11-20 08:56:24,244 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/85ad044c09ac7e7f46d086f5a2df28bd/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-11-20 08:56:24,245 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd. 2023-11-20 08:56:24,245 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 85ad044c09ac7e7f46d086f5a2df28bd: 2023-11-20 08:56:24,245 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,,1700470508218.85ad044c09ac7e7f46d086f5a2df28bd. 2023-11-20 08:56:24,245 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ef901bcc335cc63de4ed78cce9cea920, disabling compactions & flushes 2023-11-20 08:56:24,245 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920. 2023-11-20 08:56:24,245 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920. 2023-11-20 08:56:24,245 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920. after waiting 0 ms 2023-11-20 08:56:24,245 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920. 2023-11-20 08:56:24,250 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ef901bcc335cc63de4ed78cce9cea920/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-11-20 08:56:24,252 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920. 2023-11-20 08:56:24,252 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ef901bcc335cc63de4ed78cce9cea920: 2023-11-20 08:56:24,252 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700470485745.ef901bcc335cc63de4ed78cce9cea920. 2023-11-20 08:56:24,252 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7accaa801f4702def28f4caede725b1d, disabling compactions & flushes 2023-11-20 08:56:24,252 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d. 2023-11-20 08:56:24,252 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d. 2023-11-20 08:56:24,252 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d. after waiting 0 ms 2023-11-20 08:56:24,252 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d. 2023-11-20 08:56:24,253 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=48.28 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/hbase/meta/1588230740/.tmp/info/10b46bfb8e4a4515b9c69dbec4cb04d7 2023-11-20 08:56:24,255 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/7accaa801f4702def28f4caede725b1d/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=49 2023-11-20 08:56:24,257 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d. 2023-11-20 08:56:24,257 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7accaa801f4702def28f4caede725b1d: 2023-11-20 08:56:24,257 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1700470416101.7accaa801f4702def28f4caede725b1d. 2023-11-20 08:56:24,257 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6f71729b403c1b7661b596f9cabd3e13, disabling compactions & flushes 2023-11-20 08:56:24,257 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1700470414892.6f71729b403c1b7661b596f9cabd3e13. 2023-11-20 08:56:24,257 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1700470414892.6f71729b403c1b7661b596f9cabd3e13. 2023-11-20 08:56:24,257 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1700470414892.6f71729b403c1b7661b596f9cabd3e13. after waiting 0 ms 2023-11-20 08:56:24,257 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1700470414892.6f71729b403c1b7661b596f9cabd3e13. 2023-11-20 08:56:24,257 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 6f71729b403c1b7661b596f9cabd3e13 1/1 column families, dataSize=109 B heapSize=592 B 2023-11-20 08:56:24,257 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 10b46bfb8e4a4515b9c69dbec4cb04d7 2023-11-20 08:56:24,265 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=102 B at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/hbase/meta/1588230740/.tmp/rep_barrier/73aa6bce73cb44f09c19dc919e61651a 2023-11-20 08:56:24,270 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 73aa6bce73cb44f09c19dc919e61651a 2023-11-20 08:56:24,271 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=109 B at sequenceid=7 (bloomFilter=true), to=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/hbase/namespace/6f71729b403c1b7661b596f9cabd3e13/.tmp/info/feb90c73b0df4d0996cbba0da7b02043 2023-11-20 08:56:24,279 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/hbase/namespace/6f71729b403c1b7661b596f9cabd3e13/.tmp/info/feb90c73b0df4d0996cbba0da7b02043 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/hbase/namespace/6f71729b403c1b7661b596f9cabd3e13/info/feb90c73b0df4d0996cbba0da7b02043 2023-11-20 08:56:24,283 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-11-20 08:56:24,290 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/hbase/namespace/6f71729b403c1b7661b596f9cabd3e13/info/feb90c73b0df4d0996cbba0da7b02043, entries=3, sequenceid=7, filesize=4.8 K 2023-11-20 08:56:24,291 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for 6f71729b403c1b7661b596f9cabd3e13 in 34ms, sequenceid=7, compaction requested=false 2023-11-20 08:56:24,295 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/hbase/namespace/6f71729b403c1b7661b596f9cabd3e13/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=1 2023-11-20 08:56:24,296 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1700470414892.6f71729b403c1b7661b596f9cabd3e13. 2023-11-20 08:56:24,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6f71729b403c1b7661b596f9cabd3e13: 2023-11-20 08:56:24,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1700470414892.6f71729b403c1b7661b596f9cabd3e13. 2023-11-20 08:56:24,297 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c417fce1816d885109d4ed56f4041903, disabling compactions & flushes 2023-11-20 08:56:24,297 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903. 2023-11-20 08:56:24,297 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903. 2023-11-20 08:56:24,297 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903. after waiting 0 ms 2023-11-20 08:56:24,297 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903. 2023-11-20 08:56:24,300 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/c417fce1816d885109d4ed56f4041903/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-11-20 08:56:24,301 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903. 2023-11-20 08:56:24,301 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c417fce1816d885109d4ed56f4041903: 2023-11-20 08:56:24,301 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,2,1700470508218.c417fce1816d885109d4ed56f4041903. 2023-11-20 08:56:24,301 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ad7b59ca054cb36c87ef2e1f35f17d22, disabling compactions & flushes 2023-11-20 08:56:24,302 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1700470565576.ad7b59ca054cb36c87ef2e1f35f17d22. 2023-11-20 08:56:24,302 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1700470565576.ad7b59ca054cb36c87ef2e1f35f17d22. 2023-11-20 08:56:24,302 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1700470565576.ad7b59ca054cb36c87ef2e1f35f17d22. after waiting 0 ms 2023-11-20 08:56:24,302 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1700470565576.ad7b59ca054cb36c87ef2e1f35f17d22. 2023-11-20 08:56:24,307 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/ad7b59ca054cb36c87ef2e1f35f17d22/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-20 08:56:24,308 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1700470565576.ad7b59ca054cb36c87ef2e1f35f17d22. 2023-11-20 08:56:24,308 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ad7b59ca054cb36c87ef2e1f35f17d22: 2023-11-20 08:56:24,308 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,1,1700470565576.ad7b59ca054cb36c87ef2e1f35f17d22. 2023-11-20 08:56:24,308 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 32148f74faef43fe3181334f58210602, disabling compactions & flushes 2023-11-20 08:56:24,308 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1700470451259.32148f74faef43fe3181334f58210602. 2023-11-20 08:56:24,308 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1700470451259.32148f74faef43fe3181334f58210602. 2023-11-20 08:56:24,308 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1700470451259.32148f74faef43fe3181334f58210602. after waiting 0 ms 2023-11-20 08:56:24,309 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1700470451259.32148f74faef43fe3181334f58210602. 2023-11-20 08:56:24,311 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testScannerOnBulkLoadRefHFiles/32148f74faef43fe3181334f58210602/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-11-20 08:56:24,312 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1700470451259.32148f74faef43fe3181334f58210602. 2023-11-20 08:56:24,312 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 32148f74faef43fe3181334f58210602: 2023-11-20 08:56:24,312 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,,1700470451259.32148f74faef43fe3181334f58210602. 2023-11-20 08:56:24,312 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 559bfeb2e96b535ce0a8d89357bdb240, disabling compactions & flushes 2023-11-20 08:56:24,312 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240. 2023-11-20 08:56:24,312 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240. 2023-11-20 08:56:24,313 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240. after waiting 0 ms 2023-11-20 08:56:24,313 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240. 2023-11-20 08:56:24,316 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/559bfeb2e96b535ce0a8d89357bdb240/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-11-20 08:56:24,317 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240. 2023-11-20 08:56:24,317 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 559bfeb2e96b535ce0a8d89357bdb240: 2023-11-20 08:56:24,317 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700470469113.559bfeb2e96b535ce0a8d89357bdb240. 2023-11-20 08:56:24,317 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3c896a09e2b9659e521fbfa3f4c3a8b7, disabling compactions & flushes 2023-11-20 08:56:24,317 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7. 2023-11-20 08:56:24,317 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7. 2023-11-20 08:56:24,317 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7. after waiting 0 ms 2023-11-20 08:56:24,317 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7. 2023-11-20 08:56:24,320 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testCompactionWithHFileLink/3c896a09e2b9659e521fbfa3f4c3a8b7/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-11-20 08:56:24,321 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7. 2023-11-20 08:56:24,321 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3c896a09e2b9659e521fbfa3f4c3a8b7: 2023-11-20 08:56:24,321 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,1,1700470508218.3c896a09e2b9659e521fbfa3f4c3a8b7. 2023-11-20 08:56:24,322 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 612548ffeca5aef6aedcb4899d4e1a66, disabling compactions & flushes 2023-11-20 08:56:24,322 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1700470451259.612548ffeca5aef6aedcb4899d4e1a66. 2023-11-20 08:56:24,322 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1700470451259.612548ffeca5aef6aedcb4899d4e1a66. 2023-11-20 08:56:24,322 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1700470451259.612548ffeca5aef6aedcb4899d4e1a66. after waiting 0 ms 2023-11-20 08:56:24,322 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1700470451259.612548ffeca5aef6aedcb4899d4e1a66. 2023-11-20 08:56:24,325 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testScannerOnBulkLoadRefHFiles/612548ffeca5aef6aedcb4899d4e1a66/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-11-20 08:56:24,326 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1700470451259.612548ffeca5aef6aedcb4899d4e1a66. 2023-11-20 08:56:24,326 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 612548ffeca5aef6aedcb4899d4e1a66: 2023-11-20 08:56:24,326 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,2,1700470451259.612548ffeca5aef6aedcb4899d4e1a66. 2023-11-20 08:56:24,326 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ebc91fbf023be453f933eaa5806158e2, disabling compactions & flushes 2023-11-20 08:56:24,326 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1700470456262.ebc91fbf023be453f933eaa5806158e2. 2023-11-20 08:56:24,326 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1700470456262.ebc91fbf023be453f933eaa5806158e2. 2023-11-20 08:56:24,326 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1700470456262.ebc91fbf023be453f933eaa5806158e2. after waiting 0 ms 2023-11-20 08:56:24,326 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1700470456262.ebc91fbf023be453f933eaa5806158e2. 2023-11-20 08:56:24,327 INFO [regionserver/jenkins-hbase4:0.Chore.2] hbase.ScheduledChore(146): Chore: CompactedHFilesCleaner was stopped 2023-11-20 08:56:24,329 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionWithWeeklyPolicy/ebc91fbf023be453f933eaa5806158e2/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-20 08:56:24,330 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1700470456262.ebc91fbf023be453f933eaa5806158e2. 2023-11-20 08:56:24,330 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ebc91fbf023be453f933eaa5806158e2: 2023-11-20 08:56:24,330 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyPolicy,,1700470456262.ebc91fbf023be453f933eaa5806158e2. 2023-11-20 08:56:24,330 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1b2f9409842f6bf16f1fa2b0c26e8da7, disabling compactions & flushes 2023-11-20 08:56:24,330 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1700470439728.1b2f9409842f6bf16f1fa2b0c26e8da7. 2023-11-20 08:56:24,330 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1700470439728.1b2f9409842f6bf16f1fa2b0c26e8da7. 2023-11-20 08:56:24,330 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1700470439728.1b2f9409842f6bf16f1fa2b0c26e8da7. after waiting 0 ms 2023-11-20 08:56:24,330 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1700470439728.1b2f9409842f6bf16f1fa2b0c26e8da7. 2023-11-20 08:56:24,333 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithWeeklyPolicy/1b2f9409842f6bf16f1fa2b0c26e8da7/recovered.edits/49.seqid, newMaxSeqId=49, maxSeqId=1 2023-11-20 08:56:24,334 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1700470439728.1b2f9409842f6bf16f1fa2b0c26e8da7. 2023-11-20 08:56:24,334 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1b2f9409842f6bf16f1fa2b0c26e8da7: 2023-11-20 08:56:24,334 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithWeeklyPolicy,,1700470439728.1b2f9409842f6bf16f1fa2b0c26e8da7. 2023-11-20 08:56:24,334 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7d61965cf9967510cc3eaf24947bb0ef, disabling compactions & flushes 2023-11-20 08:56:24,334 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1700470533458.7d61965cf9967510cc3eaf24947bb0ef. 2023-11-20 08:56:24,334 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1700470533458.7d61965cf9967510cc3eaf24947bb0ef. 2023-11-20 08:56:24,334 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1700470533458.7d61965cf9967510cc3eaf24947bb0ef. after waiting 0 ms 2023-11-20 08:56:24,334 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1700470533458.7d61965cf9967510cc3eaf24947bb0ef. 2023-11-20 08:56:24,337 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/7d61965cf9967510cc3eaf24947bb0ef/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-20 08:56:24,338 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1700470533458.7d61965cf9967510cc3eaf24947bb0ef. 2023-11-20 08:56:24,338 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7d61965cf9967510cc3eaf24947bb0ef: 2023-11-20 08:56:24,338 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,1,1700470533458.7d61965cf9967510cc3eaf24947bb0ef. 2023-11-20 08:56:24,338 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing cc3c29cf22b5437a5aba3278559c21c2, disabling compactions & flushes 2023-11-20 08:56:24,338 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1700470565576.cc3c29cf22b5437a5aba3278559c21c2. 2023-11-20 08:56:24,338 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1700470565576.cc3c29cf22b5437a5aba3278559c21c2. 2023-11-20 08:56:24,338 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1700470565576.cc3c29cf22b5437a5aba3278559c21c2. after waiting 0 ms 2023-11-20 08:56:24,338 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1700470565576.cc3c29cf22b5437a5aba3278559c21c2. 2023-11-20 08:56:24,342 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/cc3c29cf22b5437a5aba3278559c21c2/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-20 08:56:24,343 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1700470565576.cc3c29cf22b5437a5aba3278559c21c2. 2023-11-20 08:56:24,343 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for cc3c29cf22b5437a5aba3278559c21c2: 2023-11-20 08:56:24,343 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,,1700470565576.cc3c29cf22b5437a5aba3278559c21c2. 2023-11-20 08:56:24,343 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 53dd3cf22f6da76994961de186109db6, disabling compactions & flushes 2023-11-20 08:56:24,343 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1700470451259.53dd3cf22f6da76994961de186109db6. 2023-11-20 08:56:24,343 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1700470451259.53dd3cf22f6da76994961de186109db6. 2023-11-20 08:56:24,343 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1700470451259.53dd3cf22f6da76994961de186109db6. after waiting 0 ms 2023-11-20 08:56:24,343 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1700470451259.53dd3cf22f6da76994961de186109db6. 2023-11-20 08:56:24,346 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testScannerOnBulkLoadRefHFiles/53dd3cf22f6da76994961de186109db6/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-11-20 08:56:24,346 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1700470451259.53dd3cf22f6da76994961de186109db6. 2023-11-20 08:56:24,346 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 53dd3cf22f6da76994961de186109db6: 2023-11-20 08:56:24,346 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,1,1700470451259.53dd3cf22f6da76994961de186109db6. 2023-11-20 08:56:24,346 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 37ddd3693eda6c49fa96f6147c47a803, disabling compactions & flushes 2023-11-20 08:56:24,346 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1700470533458.37ddd3693eda6c49fa96f6147c47a803. 2023-11-20 08:56:24,346 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1700470533458.37ddd3693eda6c49fa96f6147c47a803. 2023-11-20 08:56:24,346 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1700470533458.37ddd3693eda6c49fa96f6147c47a803. after waiting 0 ms 2023-11-20 08:56:24,346 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1700470533458.37ddd3693eda6c49fa96f6147c47a803. 2023-11-20 08:56:24,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/37ddd3693eda6c49fa96f6147c47a803/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-20 08:56:24,350 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1700470533458.37ddd3693eda6c49fa96f6147c47a803. 2023-11-20 08:56:24,350 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 37ddd3693eda6c49fa96f6147c47a803: 2023-11-20 08:56:24,350 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,,1700470533458.37ddd3693eda6c49fa96f6147c47a803. 2023-11-20 08:56:24,350 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a4223368d0abcd3a665a863e674f7fce, disabling compactions & flushes 2023-11-20 08:56:24,350 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1700470533458.a4223368d0abcd3a665a863e674f7fce. 2023-11-20 08:56:24,350 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1700470533458.a4223368d0abcd3a665a863e674f7fce. 2023-11-20 08:56:24,350 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1700470533458.a4223368d0abcd3a665a863e674f7fce. after waiting 0 ms 2023-11-20 08:56:24,350 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1700470533458.a4223368d0abcd3a665a863e674f7fce. 2023-11-20 08:56:24,354 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/ns/testMinorCompaction/a4223368d0abcd3a665a863e674f7fce/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-20 08:56:24,355 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1700470533458.a4223368d0abcd3a665a863e674f7fce. 2023-11-20 08:56:24,355 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a4223368d0abcd3a665a863e674f7fce: 2023-11-20 08:56:24,355 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,2,1700470533458.a4223368d0abcd3a665a863e674f7fce. 2023-11-20 08:56:24,355 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ca958e54adf0d4e15cf293b5a4212aec, disabling compactions & flushes 2023-11-20 08:56:24,355 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1700470551767.ca958e54adf0d4e15cf293b5a4212aec. 2023-11-20 08:56:24,355 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1700470551767.ca958e54adf0d4e15cf293b5a4212aec. 2023-11-20 08:56:24,355 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1700470551767.ca958e54adf0d4e15cf293b5a4212aec. after waiting 0 ms 2023-11-20 08:56:24,355 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1700470551767.ca958e54adf0d4e15cf293b5a4212aec. 2023-11-20 08:56:24,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMinorCompactionWithMonthlyPolicy/ca958e54adf0d4e15cf293b5a4212aec/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-11-20 08:56:24,358 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1700470551767.ca958e54adf0d4e15cf293b5a4212aec. 2023-11-20 08:56:24,358 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ca958e54adf0d4e15cf293b5a4212aec: 2023-11-20 08:56:24,358 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithMonthlyPolicy,,1700470551767.ca958e54adf0d4e15cf293b5a4212aec. 2023-11-20 08:56:24,358 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d2702cde56f0dcd71503062a3d396092, disabling compactions & flushes 2023-11-20 08:56:24,358 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1700470565576.d2702cde56f0dcd71503062a3d396092. 2023-11-20 08:56:24,358 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1700470565576.d2702cde56f0dcd71503062a3d396092. 2023-11-20 08:56:24,358 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1700470565576.d2702cde56f0dcd71503062a3d396092. after waiting 0 ms 2023-11-20 08:56:24,358 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1700470565576.d2702cde56f0dcd71503062a3d396092. 2023-11-20 08:56:24,361 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/default/testMajorCompactionFromAdmin/d2702cde56f0dcd71503062a3d396092/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-20 08:56:24,361 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1700470565576.d2702cde56f0dcd71503062a3d396092. 2023-11-20 08:56:24,362 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d2702cde56f0dcd71503062a3d396092: 2023-11-20 08:56:24,362 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,2,1700470565576.d2702cde56f0dcd71503062a3d396092. 2023-11-20 08:56:24,437 DEBUG [RS:0;jenkins-hbase4:38491] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-11-20 08:56:24,506 INFO [regionserver/jenkins-hbase4:0.Chore.2] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-11-20 08:56:24,512 INFO [regionserver/jenkins-hbase4:0.Chore.2] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-11-20 08:56:24,637 DEBUG [RS:0;jenkins-hbase4:38491] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-11-20 08:56:24,690 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.18 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/hbase/meta/1588230740/.tmp/table/8c669976dd0e4f22ac699095c8c8de73 2023-11-20 08:56:24,694 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8c669976dd0e4f22ac699095c8c8de73 2023-11-20 08:56:24,695 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/hbase/meta/1588230740/.tmp/info/10b46bfb8e4a4515b9c69dbec4cb04d7 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/hbase/meta/1588230740/info/10b46bfb8e4a4515b9c69dbec4cb04d7 2023-11-20 08:56:24,699 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 10b46bfb8e4a4515b9c69dbec4cb04d7 2023-11-20 08:56:24,699 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/hbase/meta/1588230740/info/10b46bfb8e4a4515b9c69dbec4cb04d7, entries=226, sequenceid=130, filesize=37.9 K 2023-11-20 08:56:24,700 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/hbase/meta/1588230740/.tmp/rep_barrier/73aa6bce73cb44f09c19dc919e61651a as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/hbase/meta/1588230740/rep_barrier/73aa6bce73cb44f09c19dc919e61651a 2023-11-20 08:56:24,703 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 73aa6bce73cb44f09c19dc919e61651a 2023-11-20 08:56:24,703 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/hbase/meta/1588230740/rep_barrier/73aa6bce73cb44f09c19dc919e61651a, entries=1, sequenceid=130, filesize=5.0 K 2023-11-20 08:56:24,704 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/hbase/meta/1588230740/.tmp/table/8c669976dd0e4f22ac699095c8c8de73 as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/hbase/meta/1588230740/table/8c669976dd0e4f22ac699095c8c8de73 2023-11-20 08:56:24,707 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8c669976dd0e4f22ac699095c8c8de73 2023-11-20 08:56:24,707 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/hbase/meta/1588230740/table/8c669976dd0e4f22ac699095c8c8de73, entries=27, sequenceid=130, filesize=6.6 K 2023-11-20 08:56:24,709 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~50.56 KB/51772, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 473ms, sequenceid=130, compaction requested=false 2023-11-20 08:56:24,712 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/data/hbase/meta/1588230740/recovered.edits/133.seqid, newMaxSeqId=133, maxSeqId=1 2023-11-20 08:56:24,713 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-11-20 08:56:24,713 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-11-20 08:56:24,713 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-11-20 08:56:24,713 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-11-20 08:56:24,838 INFO [RS:0;jenkins-hbase4:38491] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,38491,1700470412215; all regions closed. 2023-11-20 08:56:24,845 DEBUG [RS:0;jenkins-hbase4:38491] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/oldWALs 2023-11-20 08:56:24,845 INFO [RS:0;jenkins-hbase4:38491] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38491%2C1700470412215.meta:.meta(num 1700470414632) 2023-11-20 08:56:24,849 DEBUG [RS:0;jenkins-hbase4:38491] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/oldWALs 2023-11-20 08:56:24,849 INFO [RS:0;jenkins-hbase4:38491] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38491%2C1700470412215:(num 1700470413657) 2023-11-20 08:56:24,849 DEBUG [RS:0;jenkins-hbase4:38491] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-20 08:56:24,849 INFO [RS:0;jenkins-hbase4:38491] regionserver.LeaseManager(133): Closed leases 2023-11-20 08:56:24,850 INFO [RS:0;jenkins-hbase4:38491] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-11-20 08:56:24,850 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-11-20 08:56:24,851 INFO [RS:0;jenkins-hbase4:38491] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38491 2023-11-20 08:56:24,858 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38491,1700470412215 2023-11-20 08:56:24,858 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-11-20 08:56:24,858 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-11-20 08:56:24,860 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,38491,1700470412215] 2023-11-20 08:56:24,860 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,38491,1700470412215; numProcessing=1 2023-11-20 08:56:24,863 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,38491,1700470412215 already deleted, retry=false 2023-11-20 08:56:24,863 INFO [RegionServerTracker-0] master.ServerManager(554): Cluster shutdown set; jenkins-hbase4.apache.org,38491,1700470412215 expired; onlineServers=0 2023-11-20 08:56:24,863 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,36169,1700470410986' ***** 2023-11-20 08:56:24,863 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-11-20 08:56:24,863 DEBUG [M:0;jenkins-hbase4:36169] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1bb5e1b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-11-20 08:56:24,863 INFO [M:0;jenkins-hbase4:36169] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,36169,1700470410986 2023-11-20 08:56:24,863 INFO [M:0;jenkins-hbase4:36169] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,36169,1700470410986; all regions closed. 2023-11-20 08:56:24,863 DEBUG [M:0;jenkins-hbase4:36169] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-20 08:56:24,863 DEBUG [M:0;jenkins-hbase4:36169] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-11-20 08:56:24,864 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-11-20 08:56:24,864 DEBUG [M:0;jenkins-hbase4:36169] cleaner.HFileCleaner(317): Stopping file delete threads 2023-11-20 08:56:24,864 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1700470413364] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1700470413364,5,FailOnTimeoutGroup] 2023-11-20 08:56:24,864 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1700470413365] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1700470413365,5,FailOnTimeoutGroup] 2023-11-20 08:56:24,864 INFO [M:0;jenkins-hbase4:36169] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-11-20 08:56:24,864 INFO [M:0;jenkins-hbase4:36169] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-11-20 08:56:24,864 INFO [M:0;jenkins-hbase4:36169] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-11-20 08:56:24,864 DEBUG [M:0;jenkins-hbase4:36169] master.HMaster(1512): Stopping service threads 2023-11-20 08:56:24,865 INFO [M:0;jenkins-hbase4:36169] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-11-20 08:56:24,865 ERROR [M:0;jenkins-hbase4:36169] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-20,5,PEWorkerGroup] Thread[HFileArchiver-21,5,PEWorkerGroup] Thread[HFileArchiver-22,5,PEWorkerGroup] 2023-11-20 08:56:24,865 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-11-20 08:56:24,865 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-20 08:56:24,865 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-11-20 08:56:24,865 INFO [M:0;jenkins-hbase4:36169] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-11-20 08:56:24,865 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-11-20 08:56:24,866 DEBUG [M:0;jenkins-hbase4:36169] zookeeper.ZKUtil(398): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-11-20 08:56:24,866 WARN [M:0;jenkins-hbase4:36169] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-11-20 08:56:24,866 INFO [M:0;jenkins-hbase4:36169] assignment.AssignmentManager(315): Stopping assignment manager 2023-11-20 08:56:24,866 INFO [M:0;jenkins-hbase4:36169] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-11-20 08:56:24,866 DEBUG [M:0;jenkins-hbase4:36169] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-11-20 08:56:24,866 INFO [M:0;jenkins-hbase4:36169] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-20 08:56:24,866 DEBUG [M:0;jenkins-hbase4:36169] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-20 08:56:24,866 DEBUG [M:0;jenkins-hbase4:36169] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-11-20 08:56:24,866 DEBUG [M:0;jenkins-hbase4:36169] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-20 08:56:24,866 INFO [M:0;jenkins-hbase4:36169] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=512.78 KB heapSize=598.52 KB 2023-11-20 08:56:24,873 INFO [M:0;jenkins-hbase4:36169] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=512.78 KB at sequenceid=1006 (bloomFilter=true), to=hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/2b4f8ba56c294f9b8e6e44df6bbb60ca 2023-11-20 08:56:24,876 INFO [M:0;jenkins-hbase4:36169] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2b4f8ba56c294f9b8e6e44df6bbb60ca 2023-11-20 08:56:24,877 DEBUG [M:0;jenkins-hbase4:36169] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/2b4f8ba56c294f9b8e6e44df6bbb60ca as hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/2b4f8ba56c294f9b8e6e44df6bbb60ca 2023-11-20 08:56:24,880 INFO [M:0;jenkins-hbase4:36169] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2b4f8ba56c294f9b8e6e44df6bbb60ca 2023-11-20 08:56:24,880 INFO [M:0;jenkins-hbase4:36169] regionserver.HStore(1080): Added hdfs://localhost:40427/user/jenkins/test-data/ee18b841-3e2c-8fee-66a1-e67353d85a24/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/2b4f8ba56c294f9b8e6e44df6bbb60ca, entries=123, sequenceid=1006, filesize=33.3 K 2023-11-20 08:56:24,880 INFO [M:0;jenkins-hbase4:36169] regionserver.HRegion(2948): Finished flush of dataSize ~512.78 KB/525089, heapSize ~598.51 KB/612872, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 14ms, sequenceid=1006, compaction requested=false 2023-11-20 08:56:24,881 INFO [M:0;jenkins-hbase4:36169] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-20 08:56:24,881 DEBUG [M:0;jenkins-hbase4:36169] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-11-20 08:56:24,883 INFO [M:0;jenkins-hbase4:36169] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-11-20 08:56:24,883 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-11-20 08:56:24,884 INFO [M:0;jenkins-hbase4:36169] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36169 2023-11-20 08:56:24,889 DEBUG [M:0;jenkins-hbase4:36169] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,36169,1700470410986 already deleted, retry=false 2023-11-20 08:56:24,960 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-20 08:56:24,960 INFO [RS:0;jenkins-hbase4:38491] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,38491,1700470412215; zookeeper connection closed. 2023-11-20 08:56:24,960 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): regionserver:38491-0x10009ff2fad0001, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-20 08:56:24,961 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5c158542] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5c158542 2023-11-20 08:56:24,961 INFO [Listener at localhost/43513] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-11-20 08:56:24,992 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-20 08:56:24,992 INFO [M:0;jenkins-hbase4:36169] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,36169,1700470410986; zookeeper connection closed. 2023-11-20 08:56:24,992 DEBUG [Listener at localhost/43513-EventThread] zookeeper.ZKWatcher(600): master:36169-0x10009ff2fad0000, quorum=127.0.0.1:64635, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-20 08:56:24,993 WARN [Listener at localhost/43513] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-11-20 08:56:24,996 INFO [Listener at localhost/43513] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-11-20 08:56:25,104 WARN [BP-981033928-172.31.14.131-1700470407596 heartbeating to localhost/127.0.0.1:40427] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-11-20 08:56:25,105 WARN [BP-981033928-172.31.14.131-1700470407596 heartbeating to localhost/127.0.0.1:40427] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-981033928-172.31.14.131-1700470407596 (Datanode Uuid b30ba5e9-376a-41c9-8c33-f7403000e804) service to localhost/127.0.0.1:40427 2023-11-20 08:56:25,107 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c2019f36-b591-93b3-961c-17512c63a77c/cluster_0312bc5e-93c7-79f4-9931-0016dabc1303/dfs/data/data1/current/BP-981033928-172.31.14.131-1700470407596] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-11-20 08:56:25,108 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c2019f36-b591-93b3-961c-17512c63a77c/cluster_0312bc5e-93c7-79f4-9931-0016dabc1303/dfs/data/data2/current/BP-981033928-172.31.14.131-1700470407596] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-11-20 08:56:25,137 INFO [Listener at localhost/43513] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-11-20 08:56:25,282 INFO [Listener at localhost/43513] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-11-20 08:56:25,359 INFO [Listener at localhost/43513] hbase.HBaseTestingUtility(1293): Minicluster is down